Design, develop, and maintain scalable cloud-based data pipelines and ETL/ELT processes. Build and optimize data solutions on GCP (BigQuery, Dataflow), ensure data quality, governance, monitoring, and high availability. Develop backend data processing services in Java, support BI, analytics, and ML teams, troubleshoot pipeline issues, and contribute to data platform architecture and modernization.
This role is for one of the Weekday's clients
Salary range: Rs 1200000 - Rs 2500000 (ie INR 12-25 LPA)
Experience: 7+ yrs
Location: Pune, Bangalore, Chennai, Coimbatore
Job Type: full-time
We are looking for a skilled Data Engineer who is passionate about building scalable data platforms and enabling data-driven decision-making. This role involves designing, developing, and maintaining robust data pipelines, processing large-scale datasets, and ensuring the availability, reliability, and performance of data systems.
The ideal candidate will have strong expertise in cloud-based data engineering, backend development, and modern data processing technologies. You will work closely with cross-functional teams to create efficient data solutions that support analytics, reporting, machine learning, and business intelligence initiatives.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable data pipelines for processing structured and unstructured data.
- Build and optimize cloud-based data solutions using modern data engineering best practices.
- Develop and manage data ingestion, transformation, validation, and orchestration workflows.
- Create reliable ETL/ELT pipelines to support analytics, reporting, and operational use cases.
- Work with large datasets to ensure data quality, consistency, and accessibility across systems.
- Develop and optimize backend services and data processing applications using Java.
- Implement data governance, monitoring, and performance optimization practices.
- Collaborate with product, analytics, and engineering teams to understand data requirements and deliver scalable solutions.
- Troubleshoot data pipeline issues and proactively identify opportunities for improvement.
- Ensure high availability, security, and scalability of data infrastructure.
- Participate in architecture discussions and contribute to data platform modernization initiatives.
- Support business intelligence, advanced analytics, and machine learning teams with reliable data assets.
- Strong experience in Data Engineering and building scalable data processing systems.
- Proficiency in Java and cloud-native data engineering practices.
- Hands-on experience with Google Cloud Platform (GCP) and its data ecosystem.
- Strong understanding of data warehousing, data modeling, and distributed data processing concepts.
- Experience building and maintaining high-performance ETL/ELT pipelines.
- Familiarity with BigQuery, Dataflow, and other cloud-based data processing technologies is highly desirable.
- Strong SQL skills and experience working with large-scale datasets.
- Understanding of data architecture, data governance, and data quality frameworks.
- Experience with workflow orchestration, monitoring, and automation tools.
- Strong analytical thinking and problem-solving abilities.
- Ability to collaborate effectively with cross-functional stakeholders and communicate technical concepts clearly.
- Self-driven mindset with a focus on ownership, scalability, and continuous improvement.
Similar Jobs
Information Technology • Consulting
Own and drive the enterprise data platform strategy on Databricks and Snowflake. Design and maintain IaC-based infrastructure, automation, CI/CD, monitoring, and FinOps. Enforce engineering best practices, SLAs, data quality, security controls, and mentor the platform engineering team while aligning platform capabilities with business needs.
Top Skills:
AbacArmAzure DevopsBicepCi/CdDatabricksDatabricks Unity CatalogRbacSnowflakeTerraform
Fintech • Financial Services
Design, build, and maintain scalable, cloud-native data pipelines and analytical data models to support regulatory reporting and data-driven decision making. Mentor team members, ensure data quality and architectural alignment, and automate CI/CD for data deployments.
Top Skills:
AutosysAvroAWSDeltaDockerGitHadoopHiveIcebergJenkinsKubernetesLse (Light Speed Enterprise)MssqlMySQLOracleParquetPower BIProtobufPythonSparkSQLTableau
Information Technology • Database • Consulting
Lead data engineering projects using AWS and Snowflake. Design solutions, guide development and testing, ensure production deployments, perform performance tuning, manage stakeholders, and mentor team members to deliver iterative, high-quality Big Data solutions.
Top Skills:
Aws (Architecture)Aws AuroraAws Cloud MicroservicesAws EmrAws GlueAws RdsAws S3PysparkPythonSnowflakeSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
