OneMagnify Logo

OneMagnify

Senior Data Engineer

Posted 2 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Leads the architecture, development, and governance of enterprise-scale cloud data platforms on GCP. Designs data lakes, warehouses, marts, ETL/ELT frameworks, batch and event-driven pipelines, and analytics solutions. Provides technical leadership, mentoring, code and architecture reviews, and engineering standards. Ensures data quality, security, observability, monitoring, and governance while optimizing BigQuery performance and cloud costs. Collaborates with stakeholders to translate business requirements into scalable data products and supports production troubleshooting.
The summary above was generated by AI

OneMagnify is an AI native, platform-enabled B2B digital agency operating at the intersection of data, technology, and creativity. We help complex organizations drive measurable business outcomes by building smarter customer experiences and delivering highly integrated solutions across digital, media, and technology. By combining deep industry expertise with advanced analytics and artificial intelligence, we enable our clients to make better decisions, move faster, and compete more effectively in dynamic markets.


We are seeking an experienced and highly skilled Senior Data Engineer to lead the design, development, and implementation of enterprise-scale cloud data solutions. This role is responsible for architecting modern data platforms, building scalable ETL/ELT frameworks, and delivering high-performance analytics solutions on Google Cloud Platform (GCP).


The Senior Data Engineer is a technical leader and strategic contributor responsible for designing and governing modern data solutions across the organization. You will collaborate closely with Product Managers, Product Owners, Software Engineers, Data Architects, Analytics Teams, and Business Stakeholders to transform complex business requirements into scalable, secure, and performant data platforms.


You have extensive experience architecting and operationalizing large-scale data ecosystems, including Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms within GCP. You possess strong leadership capabilities, excellent stakeholder management skills, and a passion for mentoring engineering teams while driving technical excellence.


The Impact You’ll have:

As a Senior Data Engineer, you will provide technical leadership across the data ecosystem, drive engineering best practices, mentor team members, and collaborate with cross-functional stakeholders to transform business requirements into scalable, secure, and reliable data products. You will play a critical role in shaping the organization's data strategy and enabling data-driven decision-making through modern cloud technologies and innovative engineering practices.


The ideal candidate possesses deep expertise across modern data engineering technologies, strong architectural skills, and proven experience leading teams in designing and delivering large-scale cloud data platforms.


What You’ll Do:

Data Platform Architecture & Engineering
  • Design, develop, and maintain scalable cloud-native data platforms on Google Cloud Platform (GCP).
  • Architect enterprise Data Lakes, Data Warehouses, Data Marts, and Analytics Platforms.
  • Build robust, reusable, and metadata-driven ETL/ELT frameworks.
  • Develop high-volume data pipelines capable of supporting large-scale analytics and reporting workloads.
  • Implement event-driven and batch-processing architectures using modern cloud services.
  • Collaborate with Data Architects to define enterprise data models, integration patterns, and platform strategies.
  • Provide technical leadership, mentorship, and coaching to Data Engineers and ETL developers.
  • Establish data engineering best practices, coding standards, CI/CD frameworks, and governance processes.
  • Ensure data quality, observability, monitoring, lineage, governance, and security across all data products.
  • Drive performance optimization initiatives for BigQuery workloads and cloud infrastructure costs.
  • Evaluate emerging technologies, including AI/ML and Generative AI solutions, and recommend adoption strategies.
  • Partner with business stakeholders to translate requirements into scalable technical solutions.
  • Lead code reviews, architecture reviews, and technical design sessions.
  • Identify and mitigate delivery risks while ensuring successful project execution.
  • Support production environments through proactive monitoring, troubleshooting, and root-cause analysis.

Technical Leadership
  • Provide technical leadership and architectural guidance to Data Engineers and ETL developers.Establish engineering standards, coding best practices, design patterns, and governance frameworks
  • Conduct architecture reviews, code reviews, and technical design sessions.
  • Mentor team members and support skill development across the engineering organization.

What You'll Need:

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 8+ years of overall experience in Data Engineering, ETL/ELT development, and data platform delivery.
  • 5+ years of hands-on experience in Google Cloud Platform (GCP).
  • Extensive experience designing and building enterprise-scale Data Warehouses, Data Lakes, and Analytics Platforms.
  • Expert-level SQL skills with experience in performance tuning and optimization.
  • Strong expertise in Python and modern data engineering frameworks.
  • Hands-on experience with: BigQuery Google Cloud Storage (GCS) Dataflow Dataproc Cloud Run Pub/Sub Cloud Composer / Apache Airflow Cloud Functions Experience building CI/CD pipelines using GitHub, Terraform, Tekton, and Infrastructure-as-Code practices.
  • Strong understanding of distributed data processing and cloud-native architectures.
  • Experience implementing data quality, testing, observability, and monitoring frameworks.
  • Knowledge of data governance, security, privacy, and compliance best practices.
  • Experience working within Agile, Scrum, and Lean methodologies.
  • Proven ability to manage multiple stakeholders and drive technical discussions.

Future-Ready Skills (Nice to Have):

  • Google Cloud Professional Data Engineer Certification.
  • Google Cloud Associate Cloud Engineer Certification.
  • Experience with Qlik Sense, Looker, Power BI, or other BI and Analytics tools.
  • Experience with Snowflake, Databricks, or other modern data platforms.
  • Exposure to AI, Machine Learning, Generative AI, and Large Language Models (LLMs).
  • Experience leading onshore and offshore engineering teams.

Benefits

We offer a comprehensive benefits package including Medical Insurance, PF, Gratuity, paid holidays, and more.


We are an equal opportunity employer

We believe that Innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance. We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team.

OneMagnify Chennai, Tamil Nadu, IND Office

Chennai, India

Similar Jobs

2 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Hardware • Other • Appliances
Leads investigation and resolution of complex data support issues involving pipelines, transformations, data quality, reporting, and integrations. Performs root cause analysis, defines preventive controls, improves monitoring and documentation, supports production deployments, and guides junior engineers. Collaborates with technical and business stakeholders to improve data reliability, governance, performance, and operational support practices.
Top Skills: APIsCloud Data PlatformsDashboardsData ModelingData PipelinesEnterprise Data WarehousesEtl/EltSQL
3 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Automotive
Designs and operates scalable batch and streaming data pipelines, ETL/ELT frameworks, data models, APIs, and cloud-native services supporting ADAS and autonomous-driving solutions. Ensures data quality, security, governance, observability, and reliability across AWS or Azure platforms. Partners with AI/ML and MLOps teams to deliver production-ready datasets and features, while contributing to architecture, CI/CD, infrastructure automation, technical standards, and mentoring.
Top Skills: Amazon KinesisApache AirflowApache IcebergApache KafkaSparkAWSAws Step FunctionsAzureAzure Data FactoryAzure Event HubsCi/CdCloudFormationDatabricksDbtDelta LakeDockerElkEltETLGitGrafanaKibanaKubernetesMlopsNoSQLOpensearchPower BIPythonQlik SenseRest ApisSQLTerraform
9 Days Ago
Easy Apply
Remote or Hybrid
India
Easy Apply
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Leads cybersecurity data-source onboarding and integration for Zscaler’s security platform. Builds and automates Python/API-based data transformations, maps and normalizes security data, manages pipeline lifecycle activities, troubleshoots data quality, and identifies security gaps. Partners with cybersecurity SMEs and cross-functional teams to create implementation plans, communicate technical findings, and provide product improvement feedback. The role requires expertise in security platforms, diverse security-tool integrations, data modeling, SQL, and Python.
Top Skills: Ai/MlAPIsCloud LogsCmdbCnappCspmEdrPythonSIEMSQLUnified Vulnerability Management

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account