As a Data Engineer, you'll design ETL processes, work with big data technologies, optimize performance, and provide development and production support.
Job Description:
Certification Preferred: Databricks Certified Data Engineer, Informatica (IDMC)
Job SummaryWe are seeking a skilled and motivated Data Engineer with strong experience in Data Warehousing concepts, ETL/ELT development, and hands-on expertise in Informatica. The ideal candidate will have a solid understanding of data modeling, excellent communication skills, and experience working in Agile environments. Certification in Databricks is a plus.
Key Responsibilities- Design and develop ETL/ELT processes using Guardian-approved tools such as Informatica, SSIS, and Syncsort.
- Work with big data technologies including HIVE, HAWQ, Spark SQL, Python, PySpark and AWS EMR.
- Perform hands-on development in UNIX, PL/SQL, HQL, and conduct unit testing for all deliverables.
- Interpret and work with logical, physical, and conceptual data models and ER diagrams.
- Create and maintain technical documentation including functional specs, test plans, deployment guides, mapping documents, and runbooks.
- Optimize ETL and query performance, conduct impact analysis, and contribute to solution design.
- Collaborate with on-site/offshore teams to clarify requirements and resolve issues.
- Participate in all SDLC activities including requirement analysis, effort estimation, development, testing, and deployment.
- Provide production support including Level 2 on-call support and incident resolution.
- Ensure compliance with Guardian’s security and development standards.
- Engage with Guardian SMEs for knowledge transition and steady-state support.
- Drive ETL architecture design, enforce best practices, and assess existing applications for improvements.
- Identify and implement automation opportunities to improve efficiency.
- Strong understanding of Data Warehousing and Data Modeling.
- Proficiency in ETL/ELT tools – Informatica, SSIS, Syncsort.
- Experience with PL/SQL – procedures, triggers, constraints, cursors, functions.
- Familiarity with SAFe Agile methodology.
- Experience with big data tools and cloud platforms (AWS EMR, Spark SQL).
- Excellent Communication Skills – ability to clearly articulate technical concepts to both technical and non-technical stakeholders.
- Analytical Thinking – strong problem-solving skills and ability to perform root cause analysis.
- Collaboration – experience working in cross-functional teams and coordinating with on-site/offshore teams.
- Self-Motivation – ability to work independently and take ownership of deliverables.
- Adaptability – comfortable working in a dynamic environment with changing priorities.
- Attention to Detail – thorough in documentation, testing, and quality assurance.
- Proactive Mindset – ability to identify opportunities for improvement and automation.
This position can be based in any of the following locations:
ChennaiCurrent Guardian Colleagues: Please apply through the internal Jobs Hub in Workday
Top Skills
Aws Emr
Hawq
Hive
Informatica
Pl/Sql
Pyspark
Python
Spark Sql
Ssis
Syncsort
Unix
Guardian Life Chennai, Tamil Nadu, IND Office
D Block, 5th Floor, Tidel Park, #4 Rajiv Gandhi Salai Taramani, , Chennai, Tamil Nadu, India, 600 113
Similar Jobs
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
As a Lead Data Engineer, you will design, code, and deploy scalable data solutions, manage a team of engineers, and work with cloud technologies and big data tools to enhance data analytics capabilities.
Top Skills:
AWSAzureBigQueryGCPHadoop HdfsHiveJavaKafkaMetabasePostgresPysparkRedshiftSparkSQLSqoopTableau
Software
The Senior Data Engineer will design and manage RAG Vector Databases, modernize data ingestion pipelines, ensure data synchronization, and collaborate across teams for AI insights.
Top Skills:
AWSC#EltETLGlueGoKafkaLambdaMs Sql ServerOpensearchPineconePythonRagRdsS3SQLVector Database Design
Fintech • Financial Services
The Data Engineer Lead is responsible for designing and maintaining data pipelines, warehousing, and lakes while collaborating with data scientists and leading a team to innovate data solutions.
Top Skills:
AbinitioAutosysBash ScriptingData ModellingDbtETLJavaPythonSQLTivoliUnix
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
