OneMagnify Logo

OneMagnify

Databricks AI Engineer

Posted 2 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu
Senior level
In-Office
Chennai, Tamil Nadu
Senior level
This role involves maintaining and developing databases, implementing AI models, performing data analysis, and deploying machine learning solutions across cloud platforms.
The summary above was generated by AI
Administers, maintains, develops and implements policies and procedures for ensuring the security and integrity of the company databases. Implements data models and database designs, data access and table maintenance; resolves database performance issues, database capacity issues, replication, and other distributed data issues.
Job Description

ESSENTIAL DUTIES AND RESPONSIBILITIES                            

                               

  • Programming & Query Languages: Proficient in Python, and SQL for data analysis, modeling, and database management.
  • Machine Learning & AI Models: Experience with classical ML (e.g., regression, decision trees, SVM), deep learning (CNNs, RNNs, Transformers), and advanced AI (GNNs, RL, GANs, LLMs like GPT-4, Claude, LLaMA).
  • Natural Language & Vision AI: Skilled in NLP (NER, sentiment analysis, summarization) and computer vision (YOLO, ResNet, segmentation, OCR).
  • Frameworks & Libraries: Hands-on with TensorFlow, PyTorch, Scikit-learn, Keras, Hugging Face Transformers, and Spark MLlib.
  • Databricks Ecosystem: Proficient in Databricks Notebooks, MLflow, AutoML, Delta Lake, Unity Catalog, Feature Store, Model Serving, and Lakehouse AI.
  • Data Engineering & Big Data: Experience with Apache Spark, Hadoop, Kafka, Airflow, dbt, and building scalable ETL pipelines.
  • Cloud Platforms: Deploy and manage solutions on AWS (S3, SageMaker), Azure (ML, Synapse), and GCP (BigQuery, Vertex AI).
  • Statistical Analysis & Experimentation: Apply A/B testing, hypothesis testing, Bayesian methods, and time series forecasting (ARIMA, Prophet, LSTM).
  • Model Deployment & DevOps: Deploy models using Flask, FastAPI, Docker, Kubernetes, CI/CD pipelines, and integrate with APIs and Git for version control.

QUALIFICATIONS To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

EDUCATION AND/OR EXPERIENCE Bachelor’s Degree (B. A.) from four-year college or university.

In-depth understanding of all aspects of database technology with minimum five years experience in database administration or equivalent job experience.

Experience with UNIX, Linux, and Microsoft Windows operating systems.

LANGUAGE AND COMMUNICATION SKILLS Ability to read, write, follow directions, and possess above average listening skills. Strong interpersonal skills and a sensitivity to understand customer needs. Excellent written and oral communications skills are essential.  The ability to prepare written materials in a clear and concise format and in proper English is required

MATHEMATICAL SKILLS This position requires the ability to calculate figures and amounts such as discounts, interest, commissions, proportions, percentages, area, circumference, and volume as well as the ability to apply concepts of basic algebra and geometry.  

REASONING ABILITY This job requires the ability solve practical problems and deal with a variety of concrete variables in situations where only limited standardization exists and the ability to interpret a variety of instructions furnished in written, oral, diagram or schedule form.

PHYSICAL DEMANDS The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

While performing the duties of this job, the employee is regularly required to talk or hear. The employee frequently is required to stand and walk. The employee is occasionally required to sit and reach with hands and arms. The employee is required to sit at a desk and work on a computer for long periods of time.

WORK ENVIRONMENT The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

While performing the duties of this job, the employee is occasionally exposed to moving mechanical parts and high precarious places. Occasionally handles emergency or crisis situations; frequently subject to interruptions, and multiple calls and inquiries. The noise level in the work environment is usually moderate.

OneMagnify is an equal opportunity employer.

Top Skills

Airflow
Spark
AWS
Azure
Databricks
Dbt
Docker
Fastapi
Flask
GCP
Hadoop
Hugging Face Transformers
Kafka
Keras
Kubernetes
Python
PyTorch
Scikit-Learn
Spark Mllib
SQL
TensorFlow

Similar Jobs

An Hour Ago
Easy Apply
Hybrid
Chennai, Tamil Nadu, IND
Easy Apply
Senior level
Senior level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
The CRM Marketing Manager will develop email marketing campaigns, manage stakeholder relationships, analyze data trends, and collaborate on automation and personalization efforts.
Top Skills: Adobe CampaignAdobe Experience CloudAsanaBrazeCSS3HightouchHTML5Java ScriptLiquidMarketoValidity
5 Hours Ago
Easy Apply
Hybrid
Chennai, Tamil Nadu, IND
Easy Apply
Junior
Junior
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
The Trust & Safety Associate will investigate potential fraud, manage cases, improve detection systems, and collaborate with cross-functional teams to protect the platform.
Top Skills: ExcelLookerSQL
11 Hours Ago
Easy Apply
Remote or Hybrid
Chennai, Tamil Nadu, IND
Easy Apply
Senior level
Senior level
Artificial Intelligence • Big Data • Logistics • Machine Learning • Software • Transportation
As a Staff Software Engineer, you'll develop AI/ML-integrated applications, lead technical architecture, mentor teams, and ensure system quality.
Top Skills: AngularAWSAzureCi/CdDockerGCPJavaKafkaKubernetesMlflowNode.jsPythonReactSagemakerTensorFlow

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account