Designs and deploys scalable Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake across medallion layers. Builds HR data models, source-to-target mappings, reconciliation controls, governance, lineage, documentation, and data quality processes. Modernizes legacy Informatica and SQL integrations, including Oracle HCM feeds. Collaborates with distributed agile teams, mentors junior engineers, and supports production cutovers for sensitive employee data.
Description and Requirements
Key Responsibilities
• Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, spanning Bronze/Silver/Gold (medallion) layers for HR data integration and analytics.
• Build data models - logical, physical, dimensional, and integration - and maintain source-to-target mappings for workforce, organization, employee, position, job, and related HR domains.
• Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns, including inbound Oracle HCM feeds and outbound HR data files.
• Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling, and audit controls into pipelines.
• Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable.
• Produce production-ready documentation - technical designs, runbooks, data dictionaries, and support handoffs - for maintainable, observable, cost-aware solutions.
• Collaborate within a distributed delivery team, participate in agile ceremonies, mentor junior engineers, and communicate progress, blockers, and risks clearly.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or related field, with 7+ years of data engineering, ETL, or data platform experience.
• Azure Databricks & Apache Spark: 3+ years hands-on building Delta Lake pipelines with PySpark, Spark SQL, and SQL across a medallion architecture.
• Data modeling & integration: Strong logical/physical/dimensional modeling plus source-to-target mapping, reconciliation, and production cutover support.
• AI-assisted engineering: Proficiency using AI/Copilot tooling to accelerate development, code conversion, and documentation.
• Practical, delivery-focused work style, comfortable turning ambiguous legacy logic into clean target-state designs within a highly governed environment.
• Strong written and verbal communication, with the ability to overlap U.S. Eastern Time for key meetings, design reviews, and issue resolution.
Preferred Qualifications
• Suggested 3+ years modernizing legacy ETL (Informatica-to-Databricks) or building metadata-driven, configuration-driven data frameworks.
• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog, and Git-based CI/CD.
• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, workforce analytics, and consumption via Power BI, Crunchr, or similar.
• Experience supporting regulated, sensitive employee data in insurance, financial services, or HR technology.
• Detail-oriented, collaborative, and comfortable working independently against offshore delivery expectations while staying aligned to MetLife leads.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
Key Responsibilities
• Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, spanning Bronze/Silver/Gold (medallion) layers for HR data integration and analytics.
• Build data models - logical, physical, dimensional, and integration - and maintain source-to-target mappings for workforce, organization, employee, position, job, and related HR domains.
• Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns, including inbound Oracle HCM feeds and outbound HR data files.
• Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling, and audit controls into pipelines.
• Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable.
• Produce production-ready documentation - technical designs, runbooks, data dictionaries, and support handoffs - for maintainable, observable, cost-aware solutions.
• Collaborate within a distributed delivery team, participate in agile ceremonies, mentor junior engineers, and communicate progress, blockers, and risks clearly.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or related field, with 7+ years of data engineering, ETL, or data platform experience.
• Azure Databricks & Apache Spark: 3+ years hands-on building Delta Lake pipelines with PySpark, Spark SQL, and SQL across a medallion architecture.
• Data modeling & integration: Strong logical/physical/dimensional modeling plus source-to-target mapping, reconciliation, and production cutover support.
• AI-assisted engineering: Proficiency using AI/Copilot tooling to accelerate development, code conversion, and documentation.
• Practical, delivery-focused work style, comfortable turning ambiguous legacy logic into clean target-state designs within a highly governed environment.
• Strong written and verbal communication, with the ability to overlap U.S. Eastern Time for key meetings, design reviews, and issue resolution.
Preferred Qualifications
• Suggested 3+ years modernizing legacy ETL (Informatica-to-Databricks) or building metadata-driven, configuration-driven data frameworks.
• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog, and Git-based CI/CD.
• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, workforce analytics, and consumption via Power BI, Crunchr, or similar.
• Experience supporting regulated, sensitive employee data in insurance, financial services, or HR technology.
• Detail-oriented, collaborative, and comfortable working independently against offshore delivery expectations while staying aligned to MetLife leads.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Build and deliver scalable, cloud-native, API-driven applications using React, Node.js, Next.js, Azure, REST APIs, and microservices. Develop accessible, high-performance interfaces, implement CI/CD pipelines, apply DevSecOps and automated testing practices, troubleshoot production issues, and collaborate with cross-functional teams to deliver reliable software solutions.
Top Skills:
AzureCi/CdDevsecopsGithub CopilotMicroservicesNext.JsNode.jsReactRest Apis
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Develop and maintain Azure Databricks data pipelines using PySpark, Spark SQL, SQL, and Delta Lake. Support Informatica-to-Databricks modernization and HR data integrations, build source-to-target mappings and dimensional models, perform profiling, testing, reconciliation, and defect resolution, and create technical documentation. Apply data governance and access controls through Unity Catalog, participate in agile ceremonies and code reviews, and escalate risks while working under senior direction.
Top Skills:
SparkAzure Data FactoryAzure Data Lake StorageAzure DatabricksAzure DevopsAzure SqlAzure SynapseCi/CdDelta LakeGitGithub CopilotInformaticaMicrosoft PurviewOracle Hcm CloudPysparkPythonSpark SqlSQLUnity Catalog
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead Oracle HCM Cloud implementations and provide hands-on configuration across Core HR, Performance Management, Learning, and Analytics. Translate business requirements into functional and technical designs, develop Fast Formulas, HCM Extracts, OTBI and BI Publisher reports, and support integrations using HDL, HSDL, REST, and SOAP. Perform testing, production support, troubleshooting, documentation, and stakeholder collaboration throughout the implementation lifecycle.
Top Skills:
Agent BuilderBi PublisherCore HrFast FormulasHcm AnalyticsHcm ExtractsHdlHsdlLearningOracle Hcm CloudOtbiPerformance ManagementRestSoapUnix Shell ScriptingVb
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
