Photon Logo

Photon

Data Engineer | India

Reposted 26 Days Ago
In-Office or Remote
2 Locations
Senior level
In-Office or Remote
2 Locations
Senior level
Lead database design, data modeling, migrations, and schema evolution across MySQL/Postgres and GCP databases. Design and operate config-driven ETL/ELT pipelines and streaming ingestion, enable CI/CD, troubleshoot data flows, and mentor offshore DB/ETL engineers.
The summary above was generated by AI

Role Overview
We are looking for a Database Lead with strong GCP, database, and ETL experience to support a cloud-native data platform. The role involves database design, data modeling, schema evolution, data migrations, ETL pipelines, and data streaming across MySQL, PostgreSQL, and Google Cloud databases (Spanner, Cloud SQL, AlloyDB).
The candidate will act as a technical lead, collaborating with onshore architects and leading offshore DB/ETL resources as additional team members are onboarded.
Key Responsibilities
Lead data modeling, schema design, and database architecture across MySQL, PostgreSQL, Spanner, Cloud SQL, and AlloyDB.
Own data migrations (one-time migrations, incremental/delta loads, and ongoing data synchronization).
Design and manage config-driven ETL / ELT pipelines, with table-level configuration files and minimal transformations.
Support on-demand onboarding of new tables and manage schema changes / evolution.
Design and support data streams for batch and near-real-time ingestion.
Work across teams on event-driven architectures, ensuring reliable data publishing and downstream consumption.
Enable CI/CD deployments for database changes, ETL jobs, dataflows, and configurations.
Monitor and troubleshoot ETL pipelines, data syncs, and streaming jobs; support reprocessing and recovery.
Prepare and maintain playbooks, runbooks, and operational documentation.
Lead and mentor offshore DB/ETL engineers, review designs, guide implementation, and ensure delivery quality.
Mandatory Skills & Experience
5–8 years of experience in database and data engineering roles.
Proven expertise in data modeling, schema design, and data migrations.
Strong hands-on experience with MySQL and PostgreSQL.
Experience with Google Cloud databases: Spanner, Cloud SQL, AlloyDB.
Experience with ETL / ELT pipelines, data integration, and data streaming.
Strong understanding of schema evolution, delta processing, and data synchronization.
Advanced SQL skills.
Experience working on GCP, including services like Pub/Sub, Dataflow, BigQuery, and Cloud Storage.
Experience with CI/CD pipelines for data and database deployments.
Ability to technically lead offshore teams and work with onshore stakeholders.
Nice to Have
Exposure to other databases / technologies such as AS/400, MongoDB, Cassandra, and GraphQL.
Experience in enterprise data modernization or legacy-to-cloud programs.
Professional Cloud Certifications (Google / Microsoft / AWS), including:
Google Professional Data Engineer
Google Cloud Architect
Google Cloud Engineer

Photon Chennai, Tamil Nadu, IND Office

DLF IT Park 1/124 Mount Poonamallee Road Sivaji Gardens Manapakkam , Chennai, India, 600089

Similar Jobs

6 Days Ago
Remote
India
Expert/Leader
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Natural Language Processing • Consulting
Principal Data Engineer responsible for developing and supporting Databricks pipelines, integrating heterogeneous healthcare data sources, modeling unified data products, and ensuring data quality and availability. The role partners with business stakeholders, product teams, data engineers, and clinical leaders to gather requirements, create datasets, support ad hoc analytics, enable machine learning and AI use cases, and assist with acquisition integrations. Extensive healthcare data, cloud, SQL, PySpark, and Python experience is required.
Top Skills: AdtSparkAWSDatabricksEhrFhirGCPHealthcare Claims DataAzurePysparkPythonSQL
16 Days Ago
Remote
India
Senior level
Senior level
Logistics • Transportation
Designs, builds, and maintains ETL/ELT pipelines feeding Microsoft Fabric Lakehouse platforms. Responsibilities include data ingestion, bronze/silver/gold layer development, CDC, incremental loading, data quality, metadata governance, performance tuning, monitoring, automation, and low-level design documentation. The role collaborates with architects, data modelers, and business analysts to deliver reliable, reusable datasets and promote self-service analytics while applying security, resilience, compliance, and cost-optimization standards.
Top Skills: SparkAWSAzureAzure Event HubsCi/CdDelta LakeFabric Dataflows Gen2KafkaMicrosoft FabricMicrosoft PurviewOnelakeParquetPythonScalaSpark NotebooksSQLSql NotebooksVersion Control
19 Days Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Blockchain • Information Technology • Internet of Things
Designs, builds, and maintains scalable cloud data platforms and production pipelines across Azure, Databricks, Snowflake, and SAP. Responsibilities include ingestion, ETL/ELT, Lakehouse and dimensional modeling, CI/CD with Databricks Asset Bundles and Azure DevOps, data quality and observability, performance optimization, documentation, and stakeholder collaboration. The role also includes technical architecture, client advisory, engineering leadership, mentoring, and delivery of production Generative AI systems.
Top Skills: Adls Gen2Agentic Ai ArchitecturesApache AirflowApache KafkaSparkAzureAzure DatabricksAzure DevopsAzure Event HubsDatabricks Asset BundlesDatabricks Unity CatalogDatabricks WorkflowsDelta LakeDelta Live TablesDockerGenerative AiGitLarge Language ModelsPower BIPysparkPythonRetrieval-Augmented GenerationSAPSnowflakeSpark SqlSQLTableauTerraformYaml

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account