Design, build, and operate scalable ETL/ELT data pipelines and curated datasets on Hadoop/cloud platforms. Optimize performance, ensure data quality, lineage, and governance, enable analytics and ML-ready datasets, support CI/CD for data workflows, troubleshoot production issues, and collaborate with product, data science, and platform teams.
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Analyst, Big Data Analytics & Engineering
About Mastercard
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere-by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact-inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.About the Role
The Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads.
Key Responsibilities• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.• Strong problem-solving skills with ability to debug complex distributed data issues independently.• Clear written and verbal communication with both technical engineers and non-technical business stakeholders.
All About You
Technical Skills & Experience• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting • Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.• Bachelor's degree in computer science, Engineering, or equivalent practical experience.• 2.5-4 years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Analyst, Big Data Analytics & Engineering
About Mastercard
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere-by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact-inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.About the Role
The Data Engineer will design, build, and operate scalable data pipelines and curated datasets that power analytics products, reporting, and advanced modeling. Working closely with the Lead and cross-functional partners (Product, Data Science, and Platform teams), this role focuses on reliability, performance, data quality, and governance across batch and (where applicable) streaming workloads.
Key Responsibilities• Build and maintain robust ETL/ELT pipelines for ingestion, transformation, and aggregation of large-scale datasets on Hadoop and enterprise data platforms.• Develop high-performance data processing jobs using PySpark/Spark, Python, and SQL (including engines such as Impala where applicable).• Partner with Product and Analytics stakeholders to translate requirements into reusable, governed data models (facts/dimensions, curated layers, and semantic-ready datasets).• Implement and automate data quality checks, reconciliation, lineage documentation, and monitoring to ensure trust in downstream analytics and AI use cases.• Optimize pipeline performance and cost through partitioning, file formats, compute tuning, and efficient query patterns.• Optimize pipeline performance and cost through partitioning strategies, columnar file formats (Parquet, ORC, Delta), compute tuning, caching, and efficient query patterns.• Contribute to CI/CD for data workflows (testing, code reviews, deployment automation), promoting engineering best practices and maintainable codebases.• Support data governance, privacy, and security requirements (PII handling, access controls, auditability) in collaboration with platform and risk partners.• Collaborate with data scientists to publish analysis-ready and ML-ready datasets, including feature generation and repeatable data preparation processes.• Troubleshoot production issues, participate in on-call/operational rotations, and drive root-cause fixes to improve reliability.• Communicate data platform capabilities, limitations, and trade-offs clearly to technical and non-technical stakeholders.• Strong problem-solving skills with ability to debug complex distributed data issues independently.• Clear written and verbal communication with both technical engineers and non-technical business stakeholders.
All About You
Technical Skills & Experience• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem and/or cloud data platforms).• Strong hands-on experience in data engineering building production-grade pipelines on big data platforms (Hadoop ecosystem: HDFS, Hive, Impala, YARN, Oozie).• Proficiency in PySpark and Python and strong SQL skills across distributed and relational data stores.• Experience with orchestration/integration tools such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.• Solid understanding of data modeling, incremental processing patterns (CDC, SCD Type 1/2), and building curated datasets for analytics and reporting • Experience with cloud services (Azure/AWS/GCP) for data lakes, compute, and storage is preferred.• Proficiency in columnar and open table formats: Parquet, ORC, Delta Lake, Apache Iceberg, or Apache Hudi.• Strong knowledge of distributed computing patterns: partitioning, bucketing, broadcast joins, shuffle optimization.• Working knowledge of DevOps/CI-CD practices: version control (Git), automated testing, release pipelines, and observability.• Strong problem-solving skills with the ability to debug complex data issues and communicate clearly with technical and non-technical stakeholders.• Bachelor's degree in computer science, Engineering, or equivalent practical experience.• 2.5-4 years of relevant experience in data engineering or big data analytics engineering (flexible based on depth of expertise).
GenAI / LLM Data Enablement (Preferred)• Experience preparing curated, governed datasets (including semi-structured/unstructured) for AI/GenAI consumption with attention to privacy, quality, and reproducibility
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard's security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
Similar Jobs at Mastercard
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead Mastercard's India real estate portfolio: develop leasing/disposition strategy, optimize space and capacity planning, manage capital fit-out and refurbishment projects, oversee lease administration, coordinate vendors and global providers, support M&A real estate needs, and drive standardized workplace policies and continuous improvements across the region (requires ~20% travel).
Top Skills:
ExcelMicrosoft PowerpointMicrosoft Word
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Manage end-to-end sales lifecycle support for Mastercard Services: coordinate deal structuring, CRM governance, pricing approvals, contracting, billing transitions, and process improvements to ensure accurate deal execution, revenue realization, and stakeholder alignment across Sales, Finance, Legal, and Delivery.
Top Skills:
ExcelIroncladSalesforce
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Design, define, and measure operational KPIs across DealDesk workstreams; partner with workstream leads to identify process pain points and solutions; implement ETL, visualization, automation, and process improvements to drive efficiency and centralized processes.
Top Skills:
Ai ToolsAlteryxExcelPower AutomatePowerPointSignavioSQLTableauVisioWord
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
