Design, develop, and maintain scalable ETL/ELT pipelines and data models using Azure Databricks and SQL. Optimize data processing workflows, ensure data quality, support cloud data warehouse initiatives, troubleshoot pipeline performance, and collaborate with stakeholders to deliver analytics-ready data for BI and reporting.
This role is for one of the Weekday's clients
Salary range: Rs 1500000 - Rs 2700000 (ie INR 15-27 LPA)
Experience: 5+ yrs
Location: Pune, Maharashtra, India
Job Type: Full-Time
We are looking for a skilled Data Engineer with expertise in Azure Databricks, ETL, and SQL to design, develop, and optimize scalable data solutions that support enterprise analytics and business intelligence initiatives. The ideal candidate will have experience building robust data pipelines, transforming large datasets, and enabling reliable, high-performance data platforms within modern cloud environments.
In this role, you will collaborate with cross-functional teams including data architects, analysts, business stakeholders, and engineering teams to deliver efficient data integration solutions, ensure data quality, and support data-driven decision-making across the organization.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources.
- Build and optimize data processing workflows using Azure Databricks, SQL, and cloud-native technologies.
- Develop reliable data models and transformation logic to support reporting, analytics, and business intelligence requirements.
- Write, optimize, and maintain complex SQL queries, stored procedures, and data transformation scripts.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
- Ensure data quality through validation, reconciliation, and automated quality checks.
- Collaborate with business users, analysts, and technical teams to translate data requirements into scalable technical solutions.
- Support cloud-based data warehouse initiatives and data integration projects.
- Implement best practices for data governance, security, documentation, and compliance.
- Participate in performance tuning, process automation, and continuous improvement initiatives across the data platform.
- Strong hands-on experience with Azure Databricks, ETL development, and SQL.
- Proven experience building and supporting enterprise-scale data engineering solutions.
- Excellent SQL skills with expertise in query optimization and data transformation.
- Solid understanding of cloud-based data platforms, data warehousing concepts, and modern data architectures.
- Experience designing scalable and efficient data pipelines for structured and semi-structured data.
- Knowledge of data modeling, performance optimization, and data quality management practices.
- Strong analytical and problem-solving skills with attention to detail.
- Experience working in collaborative Agile development environments.
- Excellent communication and stakeholder management skills with the ability to work across technical and business teams.
- A proactive mindset with a passion for building reliable, scalable, and high-performing data platforms that drive business insights.
Similar Jobs
Artificial Intelligence • HR Tech • Professional Services • Software
Design and implement modern data warehouse solutions using Databricks and cloud (Azure/AWS). Develop, orchestrate (Airflow) and troubleshoot ETL pipelines (batch and streaming), build dimensional data models for reporting, collaborate with architects and business stakeholders, mentor team members, and drive technical discussions.
Top Skills:
AirflowApache KafkaAWSAzure Data FactoryAzure DatabricksCassandraCircleCIDatabricks Delta LakeGitHadoop (HiveImpala)KinesisMongoDBNeo4JPigPl/SqlPysparkPythonRdbmsSQLTerraformUnix Shell Scripting
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
Information Technology • Database • Consulting
Design, build, and maintain Azure-based data pipelines and data models using Synapse, Spark, SQL and ADLS. Implement ETL/ELT, ensure data quality, optimize performance, support deployment/monitoring, and collaborate with analysts, scientists, and stakeholders.
Top Skills:
Azure Data FactoryAzure Data Lake Storage (Adls)Azure DevopsAzure Synapse AnalyticsCi/CdDelta LakeEtl/EltAzurePythonSparkSQLVersion Control
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
