Top Data & Analytics Jobs in Chennai, TN

Design and operate Azure + Databricks lakehouse architectures; build batch and streaming ingestion pipelines with CI/CD, data quality, CDC, and observability; model curated datasets and semantic layers for Power BI; enforce security, compliance, and cost-optimization; collaborate with product owners and data stewards to certify enterprise datasets.

Analyze and resolve user tickets, profile source systems, design ETL mappings, develop and support ETL pipelines in Azure (ADF/Databricks), perform SQL performance tuning, create test cases and technical documentation, lead and mentor the team, and apply AI/ML techniques to accelerate the SDLC.

Design, build, and operate scalable, cloud-native data pipelines, platforms, and production backend services. Implement data models, orchestration (e.g., Airflow), CI/CD, and IaC practices. Ensure reliability, performance, monitoring, and mentor junior engineers while collaborating on architecture and deployments.

The Data Engineering Consultant will design and implement scalable data pipelines, develop data transformations using PySpark, optimize Databricks performance, and manage data orchestration and scheduling tools like Apache Airflow in the Azure ecosystem.

Design, build, and operate Azure/Databricks lakehouse pipelines (batch and streaming) with governance, data quality, observability, and cost controls. Model curated datasets and semantic layers in Power BI, manage PostgreSQL replication/CDC to lakehouse/Synapse, enforce security/compliance, and collaborate with product owners and data stewards to certify enterprise datasets.

Design and operate an Azure + Databricks lakehouse; build batch and streaming ingestion pipelines with CDC, automated data quality, CI/CD and observability; model curated datasets and semantic layers for Power BI; enforce security/compliance controls and cost optimization; collaborate with product owners and data stewards.