Design, build, and maintain Azure-based data pipelines and data models using Synapse, Spark, SQL and ADLS. Implement ETL/ELT, ensure data quality, optimize performance, support deployment/monitoring, and collaborate with analysts, scientists, and stakeholders.
Key Responsibilities
- Design, build, and maintain data pipelines using Azure services
- Develop and optimize solutions using Azure Synapse Analytics (pipelines, Spark, SQL pools)
- Implement ETL/ELT processes for ingesting and transforming data from multiple sources
- Design and manage data models to support reporting and analytics
- Work with structured and unstructured datasets in a data lake environment
- Ensure data quality, integrity, and consistency across pipelines
- Optimize performance of queries, pipelines, and storage
- Collaborate with data analysts, data scientists, and business stakeholders
- Support deployment, testing, and monitoring of data solutions
- Maintain documentation for data processes and architectures
Required Skills & Experience
- Strong hands-on experience with Microsoft Azure data services
- Proven experience with Azure Synapse Analytics (pipelines, Spark, SQL)
- Proficiency in SQL and Python
- Experience with data warehousing concepts and dimensional modeling
- Experience with ETL/ELT design and implementation
- Familiarity with Azure Data Lake Storage (ADLS)
- Understanding of distributed data processing (e.g., Spark)
- Experience with version control and CI/CD practices (Azure DevOps preferred)
Soft Skills
- Strong analytical and problem-solving abilities
- Good communication and stakeholder interaction skills
- Ability to work independently and within a team
- Attention to detail and focus on quality
Preferred Qualifications
- 6+ years of experience in Data Engineering.
- Experience with Delta Lake or similar technologies
- Exposure to Azure Data Factory
- Knowledge of performance tuning and query optimization
- Understanding of data governance and security best practices in Azure
EXL Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
.png)
Other
Design, build, and maintain scalable people-data pipelines, warehouses, and datasets using structured and unstructured sources. Improve pipeline efficiency and data quality, ensure regulatory compliance, research data warehouse tools, create dashboards for leadership, and collaborate cross-functionally to enable data-driven people analytics.
Top Skills:
AIAzure Data FactoryAzure Sql Data WarehouseBig-DataEtl ToolsGitMachine LearningPythonSQL
Information Technology • Database • Consulting
Design, build, and support Azure-based data pipelines and ETL processes using Databricks, ADF, ADLS2, Functions, and Logic Apps. Troubleshoot production issues, apply SQL and Python for data transformations, and uphold data quality, governance, and MDM practices.
Top Skills:
Adls2Azure Data FactoryAzure DatabricksAzure Function AppsLogic AppsPythonSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
