Top Data Engineer Jobs in Chennai

Build and operate production-grade AI data pipelines and financial knowledge services for equities content. Responsibilities include processing text, tables, documents, and multimedia; creating knowledge bases and search indexes; engineering RAG retrieval and citation systems; integrating LLMs and NLP models; managing orchestration, APIs, quality, cost, observability, reliability, and scalable production operations.

As a hands-on data engineer, you'll build and enhance scalable data platforms, develop data pipelines, and collaborate with various teams to improve data solutions and system performance.

Lead technical direction for data platform capabilities: design and maintain data pipelines, reporting models, and data governance to support trusted metrics and AI/LLM agentic workflows. Drive architectural improvements, mentor engineers, collaborate on roadmaps, and represent technical capabilities externally.

Build governed Databricks Lakehouse foundations and productionize machine learning and GenAI solutions, including forecasting, anomaly detection, NLP, RAG, and predictive analytics. Develop reliable batch and streaming workflows, CI/CD, monitoring, governance, security, lineage, and semantic models. Collaborate with product, data, platform, and domain teams to deliver measurable customer value while meeting reliability, compliance, cost, and operational objectives.

Serve as data steward and subject-matter expert for a mobile banking platform. Design and guide implementation of data collection, storage, retrieval, message content/metadata, and data-management best practices. Maintain and improve data quality, guide report development, and provide data-driven insights on customers, usage, and performance.

Design, develop, and implement advanced statistical and machine learning algorithms. Analyze disparate data sources to discover insights, build predictive models, prototype solutions, and collaborate with engineers to productionize models. Communicate findings to business and IT stakeholders and define system and functional requirements.

Lead backend and data-platform architecture while remaining hands-on with Java production code. Design and operate distributed systems for event ingestion, analytical querying, data processing, and low-latency serving. Work with ClickHouse, BigQuery, Bigtable, Kafka, Redis, GCP, and Dataflow to solve scalability, reliability, performance, and data-correctness challenges. Set technical direction, review designs, mentor engineers, and guide platform convergence across Wingify and AB Tasty.

Own the production event-streaming platform supporting the k0rdent-ai control plane. Design and operate Kafka infrastructure, CDC and connector pipelines, schema governance, stream processing, Kubernetes deployments, and infrastructure automation. Build self-service onboarding, observability, security, multi-tenant isolation, delivery guarantees, and disaster recovery. Partner with backend and SRE teams, participate in on-call, document architecture, and mentor engineers.

Lead data engineering design and delivery for CRM data platforms supporting member aggregation, segmentation, audiences, campaigns, reporting, and Connect use cases. Build and optimize SQL workflows across MySQL and Redshift, operate Iceberg-based lakehouse models, own pipeline and infrastructure reliability, and mentor engineers. Partner with Product and engineering teams using Agile, Lean, DevOps, CI/CD, and modern data quality practices.

Design, develop, and coordinate cloud data solutions using Snowflake, Python, and AWS. Support product releases, deployments, testing, and post-install support. Collaborate with architects and tech leads, troubleshoot issues, and maintain documentation. Contribute to agile squads, adopt new technologies, and enable Fidelity Wealth business data needs.

Design, build, and maintain cloud data pipelines and architectures using SQL, Python, Snowflake, and AWS. Implement CI/CD for data workflows, use developer assistance tools, and collaborate across teams to deliver reliable data solutions.

Design, build and maintain ETL mappings and data models; write SQL and Snowflake queries; manage ETL/infrastructure on AWS (EC2); use Informatica, Control-M and ServiceNow; script in Python/Shell/PowerShell; collaborate with onshore/offshore teams and define BI delivery strategy.

Develop and maintain data pipelines and applications using Python and Pandas, apply OOP and data structures, write and optimize SQL, and communicate with stakeholders. Familiarity with Agile, DevOps/CI-CD tools (Jenkins, Git, Jira), AWS, web frameworks (Django/Flask), and Snowflake is a plus.

Perform data migration/refresh from production, support Python-based data refresh framework, run post-migration fixes, validate and reconcile data, monitor and resolve batch jobs and pipeline issues, perform performance checks, and coordinate with dependent teams.

Design, build, and maintain ELT/data pipelines and workflow orchestration using Airflow, Python, and PySpark. Develop custom connectors, implement DataOps and CI/CD for data, monitor and validate data flows, collaborate with cross-functional teams, and document data workflows and governance.

Design, build, and maintain scalable ELT/data pipelines and connectors using Airflow, Python, and PySpark. Implement DataOps and CI/CD for data workflows, monitor and troubleshoot pipelines, validate data quality, collaborate with cross-functional teams, and document data processes and governance.

Join the Event Streaming and Data Replication platform as a Data Engineer to design, build, and operate cloud-native data platforms. Work with Airflow, Spark, Kubernetes, and Python; deploy containerized apps on AWS/Azure; use IaC (Terraform/CFT/ARM); implement CI/CD (GitHub, Artifactory, Jenkins); configure monitoring and alerts; and collaborate across teams to deliver highly available, scalable solutions.

Design, build, and maintain ELT/data pipelines and workflow orchestration using Airflow, Python, and PySpark. Develop custom connectors to ingest diverse data, implement DataOps and data CI/CD pipelines, monitor and troubleshoot pipelines, validate data quality, collaborate with cross-functional teams, document workflows, and work with large-scale distributed datasets and visualization tools.

Design, build, and optimize ETL pipelines and data warehouses using SQL, AWS Glue, and S3. Investigate and resolve data issues, develop Python-based solutions and small web apps, and own requirements, design, and end-to-end delivery for change requests.

Build and maintain Snowflake and SQL Server data pipelines for an operational data store, including ingestion, transformation, schema modeling, migrations, CI/CD, data quality testing, and legacy batch-to-API modernization. Collaborate with domain teams and architects to support customer, loan, payment, and interaction data. Ensure data accuracy, lineage, observability, and performance while applying generative AI tools to accelerate development and testing.

Provide onsite acquisition and analysis of drilling data during rig operations, install and maintain GEOLOG systems, perform real-time monitoring, generate technical logs and reports, act as first-line client technical support, and manage/train mud logging team while ensuring rig safety compliance.

Build and operate a scalable data platform: design and maintain ETL/ELT pipelines, Bronze/Silver/Gold data layers, data models and semantic layers, manage migrations and schema changes, ensure data quality/observability, enable analytics and future event-driven/recommendation systems, and use AI-assisted workflows to accelerate engineering.

Lead the data team to build scalable data products, create data pipelines, partner with business teams, and ensure data quality while impacting revenue and decision-making.

Owner of company-wide reporting and analytics for Growth, Marketing, Product, Finance and Operations. Build and maintain dashboards, automated reports and data pipelines (dbt), ensure data quality and governance, run growth and product analyses (CAC, ROAS, LTV, retention), support A/B testing and ad-hoc decision support, leverage AI for automation, and coordinate VAs on data tasks.

Build and operate ingestion and transformation pipelines to turn messy insurance data into clean datasets. Design bronze/silver/fact layers, model and tune Postgres and analytical stores, define KPIs and reconciliation checks, orchestrate observable data jobs, and ensure end-to-end data quality for analytics and AI products.