The Data Engineer is responsible for designing and maintaining ELT/ETL jobs, extracting data from various sources, conducting tests, and guiding team members in data engineering practices. They work with SQL, Informatica, AWS, and data reporting tools.
Key responsibilities and accountabilities: • Design, build and maintain complex ELT/ETL jobs that deliver business value.• Extract, transform and load data from various sources including databases, APIs, and flat files using IICS or Python/SQL.• Translate high-level business requirements into technical specs• Conduct unit testing, integration testing, and system testing of data integration solutions to ensure accuracy and quality• Ingest data from disparate sources into the data lake and data warehouse• Cleanse and enrich data and apply adequate data quality controls• Provide technical expertise and guidance to team members on Informatica IICS/IDMC and data engineering best practices to guide the future development of MassMutual's Data Platform.• Develop re-usable tools to help streamline the delivery of new projects• Collaborate closely with other developers and provide mentorship• Evaluate and recommend tools, technologies, processes and reference
Architectures• Work in an Agile development environment, attending daily stand-up meetings and delivering incremental improvements• Participate in code reviews and ensure all solutions are lined to architectural and requirement specifications and provide feedback on code quality, design, and performance
Skillsets:• Data: 3+ years of experience with data analytics and data warehousing. Sound knowledge of data warehousing concepts.• SQL: 3+ years of hands-on experience on SQL and query optimization for data pipelines.• ELT/ETL: 3+ years of experience in Informatica/ 1+ years of experience in IICS/IDMC• Migration Experience: Experience Informatica on prem to IICS/IDMC migration• Cloud: 3+ years' experience working in AWS cloud environment• Python: 3+ years of hands-on experience of development with Python• Workflow: 2+ years of experience in orchestration and scheduling tools (e.g. Apache Airflow)• Advanced Data Processing: Experience using data processing technologies such as Apache Spark or Kafka• Troubleshooting: Experience with troubleshooting and root cause analysis to determine and remediate potential issues• Communication: Excellent communication, problem-solving and organizational and analytical skills• Able to work independently and to provide leadership to small teams of developers.• Reporting: Experience with data reporting (e.g. MicroStrategy, Tableau, Looker) and data cataloging tools (e.g. Alation)• Experience in Design and Implementation of ETL solutions with effective design and optimized performance, ETL Development with industry standard recommendations for jobs recovery, fail over, logging, alerting mechanisms.
Architectures• Work in an Agile development environment, attending daily stand-up meetings and delivering incremental improvements• Participate in code reviews and ensure all solutions are lined to architectural and requirement specifications and provide feedback on code quality, design, and performance
Skillsets:• Data: 3+ years of experience with data analytics and data warehousing. Sound knowledge of data warehousing concepts.• SQL: 3+ years of hands-on experience on SQL and query optimization for data pipelines.• ELT/ETL: 3+ years of experience in Informatica/ 1+ years of experience in IICS/IDMC• Migration Experience: Experience Informatica on prem to IICS/IDMC migration• Cloud: 3+ years' experience working in AWS cloud environment• Python: 3+ years of hands-on experience of development with Python• Workflow: 2+ years of experience in orchestration and scheduling tools (e.g. Apache Airflow)• Advanced Data Processing: Experience using data processing technologies such as Apache Spark or Kafka• Troubleshooting: Experience with troubleshooting and root cause analysis to determine and remediate potential issues• Communication: Excellent communication, problem-solving and organizational and analytical skills• Able to work independently and to provide leadership to small teams of developers.• Reporting: Experience with data reporting (e.g. MicroStrategy, Tableau, Looker) and data cataloging tools (e.g. Alation)• Experience in Design and Implementation of ETL solutions with effective design and optimized performance, ETL Development with industry standard recommendations for jobs recovery, fail over, logging, alerting mechanisms.
Top Skills
Alation
Apache Airflow
Spark
AWS
Iics
Kafka
Looker
Microstrategy
Python
SQL
Tableau
Similar Jobs at MassMutual India
Big Data • Fintech • Information Technology • Insurance • Financial Services
Responsible for designing and implementing ETL solutions, managing data workflows, and optimizing data pipelines while ensuring high data quality and performance across cloud environments.
Top Skills:
AlationApache AirflowSparkAWSIdmcIicsInformaticaKafkaLookerMicrostrategyPythonSQLTableau
Big Data • Fintech • Information Technology • Insurance • Financial Services
Lead data engineering efforts, providing technical leadership and expertise in data manipulation, cloud platforms, and workflow automation.
Top Skills:
Apache AirflowAWSGitJenkinsPythonSnowflakeSQLVertica
Big Data • Fintech • Information Technology • Insurance • Financial Services
The role involves application integration, API processes, database modeling, and utilizing tools for data access, analysis, and governance. Requires strong full-stack development skills and experience with CI/CD and cloud-based technologies.
Top Skills:
AirflowGitJenkinsNode.jsPostgresPythonReactRedshiftSQLVertica
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
