Top Data Engineer Jobs in Chennai

Design, build, and optimize end-to-end data pipelines for large structured and unstructured data. Implement near-real-time ETL, data validation, monitoring, and performance optimization. Collaborate with stakeholders, document designs and workflows, and provide technical guidance to the team.

Design, build, and optimize PySpark applications and ETL pipelines to process large-scale datasets from relational, NoSQL, file, and streaming sources. Ensure data quality, implement error handling, and collaborate with analysts, scientists, and architects to deliver performant data solutions.

Design, model, and optimize relational and analytical data structures for OLTP and data warehouse systems. Build ER diagrams, define modeling standards, manage metadata with tools like Erwin/ER Studio, and drive data cataloging/lineage using Alation/Collibra. Perform performance tuning, sandbox POCs, handle time-series/history, and collaborate with engineers, architects, and product teams while documenting and enforcing governance.

Design, configure, and support backend software and APIs; manage configuration files and environments; test and document API endpoints; collaborate on system data flow; participate in large-scale live data migrations (billions of records) into FinCloud; produce documentation and troubleshooting guides; work in agile teams and support integration and observability efforts.

Design, build and maintain cloud-oriented big data solutions for ingestion, processing, cleaning and exposition. Improve data quality, implement ETL and data-warehouse architectures, and collaborate with DDS/Data Foundation teams to ensure platform reliability.

Senior Java engineer responsible for building data lake and big data solutions (preferably on Spark) with cloud experience (Azure/AWS/GCP), REST services, OOA/OOD and JEE design patterns, PostgreSQL expertise, TDD practices, and working in Agile teams. Optional: front-end (Angular/React), Docker/Kubernetes, investment banking domain knowledge.

Lead migration of a legacy data warehouse to Microsoft Fabric, design and implement a medallion (lakehouse) architecture, perform Fabric fitment assessments, define target cloud architecture and operating model, create migration roadmaps, and deliver a Proof of Value/MVP while collaborating with customer engineering teams.

Build and operate automated data quality checks, monitoring, alerting, and dashboards; integrate quality into data pipelines and governance tooling; automate anomaly detection and support auditors, analysts, and stewards to surface issues in near-real-time.

The Senior Data Engineer will build and optimize data pipelines in Azure Databricks, migrate existing pipelines from Azure Synapse, and design scalable data models to support a financial services client's data platform modernization.

Responsible for guiding teams in utilizing technology effectively, mentoring colleagues and devising advanced solutions to meet client challenges.

As a Senior Engineer in Data Analytics, you'll work on challenging problems using cutting-edge technology alongside talented colleagues to drive innovative solutions.

The Senior Staff Engineer, Data Science role involves guiding team direction, solving complex challenges for clients, and leveraging technical expertise to innovate solutions.

The Principal Engineer, Data Science role involves leading data science projects and providing strategic insights using extensive IT experience.

As a Senior Engineer for Strategic Data Solutions, you will manage data warehousing, reporting, and analytics for internal operations and external partners. Responsibilities include collaborating with business units, providing insights, and ensuring high-quality data reporting.

The Principal Data Science Engineer will leverage statistical analysis and machine learning to optimize airline revenue performance and customer experience, collaborating with teams to develop data models and algorithms, and support product development cycles.

The role involves building and scaling the Acceldata Open Data Platform, focusing on observability, coding, debugging, and collaborating with teams and the open-source community.

The Snowflake Senior Data Engineer will lead projects in data engineering, utilizing Snowflake and various AWS services to optimize data workflows and storage, while also guiding the team and collaborating with stakeholders.

Design, build, and optimize scalable data pipelines and models using Spark, Kafka, Airflow, dbt, and SQL across GCP and AWS. Ingest and normalize marketing and analytics data, ensure data quality and governance, support analytics and reporting, and collaborate with cross-functional global teams.

Design, operate, and secure scalable batch and streaming data pipelines and platforms. Own ingestion, transformation, serving, data quality, and access controls. Partner with product, risk, compliance, and InfoSec to ensure production reliability, correctness, and audit readiness for financial data.

Design, build, and scale cloud-native Python backend services and data-backed applications. Develop RESTful APIs, microservices, and asynchronous event-driven systems. Deploy and operate production workloads on Kubernetes and at least one public cloud (AWS or Azure). Work with cloud data warehouses (Snowflake or Databricks) and relational databases, ensuring scalable, reliable distributed systems.

As a Principal Engineer for Data Infrastructure, you'll oversee our databases and data warehousing, optimize performance, and lead technology integrations to enhance data processing capabilities.

The role involves building a centralized data lake on GCP, developing SPARK-powered data pipelines, ensuring data quality, and collaborating with cross-functional teams for advanced analytics and data models.

The Senior Data Analytics Engineer at MariaDB designs and builds data pipelines, writes SQL queries, develops internal tools, and translates data into actionable insights. They will collaborate closely with stakeholders and leverage AI tools to enhance analytics workflows.