Top Data Engineer Jobs in Chennai

Design and own end-to-end data platform architecture, build ingestion and transformation pipelines, model multi-tenant datasets, optimize Postgres and ClickHouse performance/cost, implement orchestration and observability, define data quality and reconciliation standards, and mentor data/product engineers.

Support electrical design, engineering, commissioning, and delivery of liquid-cooled data centre solutions: prepare layouts, SLDs, wiring diagrams, BOMs, perform load calculations, assist testing/FAT/SAT, troubleshoot commissioning issues, coordinate cross-functional teams, and ensure compliance with IEC/NEC/IEEE and company HSE standards.

Design, implement, and lead large-scale generative AI and ML systems (LLM fine-tuning, RAG, agents, Graph ML). Build REST APIs, deploy with Docker/Kubernetes, optimize big-data workflows, mentor engineers, and operate ML services on cloud platforms.

Own and automate end-to-end incentive calculation pipelines, translate business rules into auditable data workflows, build monitoring and reconciliation dashboards, ensure accuracy and auditability across multiple products and countries, and partner with Sales, Finance, and field teams to resolve discrepancies and support escalations.

Build and maintain end-to-end data pipelines using PySpark and SQL on Databricks/Delta. Establish data modeling and pipeline best practices, create AI-ready analytical datasets, troubleshoot pipeline issues, and collaborate with stakeholders to embed business logic and optimize reliability, efficiency, and performance.

As a Data Engineer, you'll build and monitor large-scale data pipelines, develop the DBT setup for data transformation and solve customer problems using your SQL skills.

Manage and support AKS-based enterprise data platform infrastructure, administer Apache NiFi, Azure Event Hub and Functions, implement CI/CD with Azure DevOps, automate infrastructure with Terraform/Bicep/ARM, monitor with Azure Monitor and Log Analytics, troubleshoot production incidents, ensure security, capacity planning, and collaborate with data engineering teams.

Lead the architecture and implementation of a distributed data platform for microscopy, ensuring scalability and high-performance in data management.

As a key member of the Data Infrastructure team, you will develop and optimize software features for Apache Hudi's transactional engine, enhance database performance, and solve complex data processing challenges.

As a Senior Data Engineer, you will architect the AI-native Data Platform, optimize performance, ensure data governance, and mentor engineers on best practices.

Design, build, and optimize high-volume data pipelines using Python, Databricks and Spark on Azure. Create and maintain automation test suites (Azure DevOps), perform manual/load/exploratory testing, collaborate with BAs and developers to meet sprint goals, and assist with sprint estimation and delivery.

Design, build, and operate scalable data engineering services and ingestion pipelines (CDC/streaming). Develop and optimize a centralized analytics warehouse, data models, and aggregation strategies. Build APIs, enforce multi-tenant security and data governance, monitor pipeline health, improve automation and observability, and ensure production reliability through strong engineering practices.

The Senior Data Scientist & Engineer will build and manage data infrastructure, analyze product usage, build models, track metrics, run experiments, and communicate insights to guide product decisions.