Design, build, optimize, and maintain scalable GCP-based ETL and ELT data pipelines using BigQuery, Dataflow, Cloud Storage, Python, and SQL. Collaborate with cross-functional teams to define data requirements, transform large-scale datasets, monitor pipeline performance, troubleshoot reliability issues, and ensure data integrity within budget and operational constraints. The role is fully onsite in Chennai with a four-day work week.
Data Engineer (GCP)
Summary
We are seeking an experienced Data Engineer with 6 to 9 years of expertise to join our team in Chennai on a fully onsite basis. In this critical role, you will design, build, and maintain scalable data pipelines leveraging Google Cloud Platform (GCP) to drive our data infrastructure forward. Your work will be essential in transforming raw data into actionable insights, ensuring high availability and performance for our analytics ecosystem while adhering to strict budget and operational constraints.
Responsibilities
- Design and implement robust ETL/ELT pipelines using GCP services such as BigQuery, Dataflow, and Cloud Storage.
- Develop and optimize complex SQL queries and Python scripts to process large-scale datasets efficiently.
- Collaborate with cross-functional teams to define data requirements and deliver solutions that meet business objectives.
- Monitor data pipeline performance and troubleshoot issues to ensure data integrity and system reliability.
- Participate in the F2F drive interview process on September 26 to help identify top-tier talent for the team.
Requirements
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field with 6 to 9 years of relevant experience.
- Proven expertise in Google Cloud Platform (GCP) is mandatory, with a strong portfolio of cloud-based data projects.
- Proficiency in Python and SQL is required for developing data solutions and querying databases.
- Experience working in an onsite environment with a 4-day work week in Chennai is necessary.
- Ability to work within a compensation budget of up to 30 LPA and adapt to a 30-day notice period.
Similar Jobs
Artificial Intelligence • Consulting
Develop and maintain batch and streaming data pipelines on Google Cloud. Build complex data transformations, orchestrate ETL workflows, perform data migrations, and maintain data warehouses and data lakes. The role requires expertise in BigQuery, Composer, GCS, Cloud SQL, Dataflow, Dataproc, IAM, Python, SQL, and PySpark, along with strong database, data modeling, communication, and problem-solving skills.
Top Skills:
A2AAdkApache AirflowBigQueryClaude CodeCloud ComposerCloud SqlCodexConversational AiData FusionDataflowDataprocDatastreamDbtGemini Code AssistGithub CopilotGoogle Cloud PlatformGoogle Cloud StorageIamPysparkPythonSQL
Edtech • HR Tech • Information Technology • Professional Services
Designs, builds, and maintains scalable data pipelines using Python and GCP. Develops complex SQL queries, implements ETL/ELT workflows, supports data warehousing, monitors pipeline performance, troubleshoots issues, and ensures data integrity, security, scalability, and operational continuity through documentation and cross-functional collaboration.
Top Skills:
Google Cloud Platform (Gcp)PythonSQL
Information Technology
Design, build, and optimize scalable GCP data pipelines and BigQuery data warehouses. Develop ETL/ELT workflows, implement data modeling, ensure data quality, optimize query performance and costs, maintain orchestration with Cloud Composer/Dataflow/Pub‑Sub, and automate deployments with CI/CD while enforcing security and governance.
Top Skills:
BigQueryCi/Cd PipelinesCloud Composer (Airflow)Cloud FunctionsCloud RunCloud Storage (Gcs)DataflowGitMySQLPostgresPub/SubPythonShell ScriptingSQLSQL Server
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
