Weekday, Inc. Logo

Weekday, Inc.

GCP Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Mid level
In-Office
Chennai, Tamil Nadu, IND
Mid level
Design, build, and optimize scalable GCP-based data pipelines for batch and real-time processing. Develop ETL/ELT workflows using Python and PySpark, ingest data from various sources, and work with BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, and Composer. Ensure data quality, performance tuning, monitoring, and automation while collaborating with architects, analysts, and data scientists to deliver production-ready cloud data solutions.
The summary above was generated by AI

𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀

𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟭𝟬𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟮𝟬𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟭𝟬-𝟮𝟬 𝗟𝗣𝗔)

Experience: 3+ yrs

Location: Bengaluru, Karnataka, India, Chennai, Tamil Nadu, India

Job Type: Full-time

We are looking for a skilled GCP Data Engineer to design, develop, and optimize scalable cloud-based data platforms using Google Cloud Platform (GCP). This role is ideal for professionals with strong expertise in PythonPySpark, and modern data engineering practices who are passionate about building reliable, high-performance data pipelines that power analytics, reporting, and machine learning initiatives.

As a GCP Data Engineer, you will collaborate with data architects, analysts, data scientists, and application teams to build robust data solutions that process large volumes of structured and unstructured data. You will play a key role in designing cloud-native data pipelines, optimizing data processing workloads, ensuring data quality, and implementing best practices for scalability, security, and performance. This position offers the opportunity to work with modern cloud technologies while contributing to enterprise-wide data transformation initiatives.


RequirementsKey Responsibilities
  • Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP) for batch and real-time data processing.
  • Build robust ETL/ELT workflows using PythonPySpark, and cloud-native data processing frameworks.
  • Develop and optimize data ingestion pipelines from multiple enterprise systems, APIs, databases, and streaming platforms.
  • Work with BigQuery, Cloud Storage, Dataproc, Dataflow, Pub/Sub, and other GCP services to deliver efficient data solutions.
  • Transform, cleanse, validate, and enrich large datasets while maintaining high standards of data quality and consistency.
  • Optimize data processing performance, resource utilization, and cloud infrastructure costs across GCP environments.
  • Collaborate with data architects, analytics teams, and business stakeholders to understand requirements and implement scalable data models.
  • Implement monitoring, logging, error handling, and automated recovery mechanisms for production data pipelines.
  • Develop reusable data engineering frameworks, automation scripts, and deployment processes following DevOps best practices.
  • Create and maintain technical documentation, data lineage, and operational procedures while supporting continuous improvement initiatives.
What Makes You a Great Fit
  • 3+ years of hands-on experience in Data Engineering with strong expertise in Google Cloud Platform (GCP).
  • Strong programming skills in Python and PySpark for large-scale data transformation and processing.
  • Experience working with GCP services such as BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, Composer, or equivalent cloud-native technologies.
  • Solid understanding of ETL/ELT development, distributed data processing, and cloud data architectures.
  • Experience designing scalable data models, optimizing SQL queries, and improving pipeline performance.
  • Familiarity with workflow orchestration tools, CI/CD pipelines, version control systems, and DevOps practices.
  • Good understanding of data quality, governance, security, and monitoring best practices in cloud environments.
  • Strong analytical, debugging, and problem-solving skills with the ability to work on complex data engineering challenges.
  • Excellent communication and collaboration skills with experience working across cross-functional engineering and analytics teams.
  • Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related discipline, with a passion for building modern cloud-based data platforms.

Similar Jobs

5 Days Ago
In-Office or Remote
India
Mid level
Mid level
Information Technology
Design, build, and optimize scalable GCP data pipelines and BigQuery data warehouses. Develop ETL/ELT workflows, implement data modeling, ensure data quality, optimize query performance and costs, maintain orchestration with Cloud Composer/Dataflow/Pub‑Sub, and automate deployments with CI/CD while enforcing security and governance.
Top Skills: BigQueryCi/Cd PipelinesCloud Composer (Airflow)Cloud FunctionsCloud RunCloud Storage (Gcs)DataflowGitMySQLPostgresPub/SubPythonShell ScriptingSQLSQL Server
15 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Artificial Intelligence • HR Tech • Professional Services • Software
Design, build, and operate data pipelines and ETL workflows on GCP using BigQuery, Dataflow, Cloud Composer and Dataproc. Develop SQL-based analytics, implement data processing with Python/Java and PySpark, and apply Dataplex for data governance. Collaborate with teams to deliver scalable, production-ready data solutions.
Top Skills: BigQueryCloud ComposerDataflowDataplexDataprocGcp Data EngineeringJavaPysparkPythonSQL
9 Days Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Fintech • Financial Services
The Senior Data Engineer will architect and implement cloud data platforms, leading a team to deliver high-performance solutions and collaborate with product teams on data transformation initiatives.
Top Skills: APIsBig DataConfluenceGCPGitJavaJenkinsJIRAKafkaNoSQLPythonRdbmsScalaSparkSplunkXlr

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account