Lead data engineering projects using AWS and Snowflake. Design solutions, guide development and testing, ensure production deployments, perform performance tuning, manage stakeholders, and mentor team members to deliver iterative, high-quality Big Data solutions.
Role: Lead Data Engineer Experience: 9–12 years
Location : Pune
Must-Have Skills:
- 9+ years of relevant experience in Data Engineering and project delivery.
- Strong expertise in Big Data concepts and cloud implementation projects.
- Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
- Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
- Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
- Strong problem-solving abilities, analytical skills, and aptitude for ownership.
- Skilled in Agile Methodology with experience in iterative project deliveries.
- Quick learner with the ability to lead team members in adopting new technologies.
- Exceptional communication and stakeholder management skills.
Good-to-Have Skills:
- Familiarity with DevOps tools and practices (e.g., Jenkins, Git) and experience in CI/CD pipelines.
- Knowledge of Spark, SQL (with Snowflake exposure), and advanced Big Data Concepts.
- Experience with cloud migrations and development projects
- Knowledge of US insurance and reinsurance domain
- Knowledge of Data Vault 2.0
Role & Responsibilities:
- Lead and oversee project delivery, ensuring timely completion with high quality.
- Collaborate with clients and offshore leads to gather requirements and define high-level designs.
- Direct development and unit testing activities while maintaining strong alignment with project goals.
- Communicate effectively with stakeholders, providing regular updates on task and project statuses.
- Identify, track, and address project risks or issues promptly.
- Work closely with management to ensure seamless execution of tasks.
- Provide technical guidance to the team, outlining design, implementation, and delivery strategies.
Education:
- Bachelor’s Degree in Engineering (BE/B.Tech) from a reputed institution.
Role & Responsibilities:
- Lead and oversee project delivery, ensuring timely completion with high quality.
- Collaborate with clients and offshore leads to gather requirements and define high-level designs.
- Direct development and unit testing activities while maintaining strong alignment with project goals.
- Communicate effectively with stakeholders, providing regular updates on task and project statuses.
- Identify, track, and address project risks or issues promptly.
- Work closely with management to ensure seamless execution of tasks.
- Provide technical guidance to the team, outlining design, implementation, and delivery strategies.
Bachelor’s Degree in Engineering (BE/B.Tech) from a reputed institution.
EXL Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Information Technology • Database • Consulting
Lead design and build of scalable AWS data lake/lakehouse solutions using S3 and Iceberg. Develop and optimize PySpark ETL/ELT pipelines, orchestrate with Airflow, integrate Snowflake, ensure data quality/governance, lead technical design, and mentor a team of data engineers.
Top Skills:
Apache AirflowApache IcebergAWSPysparkPythonS3Snowflake
Healthtech • Information Technology • Software • Telehealth
Maintain and audit a comprehensive provider database: extract and analyze data with SQL, merge sources to build accurate provider profiles, update large datasets in Excel/Sheets, verify provider information via outreach, and ensure data privacy and compliance.
Top Skills:
Ai-Powered ToolsGoogle SheetsExcelSQL
Healthtech • Information Technology • Software • Telehealth
Zocdoc seeks to connect with candidates interested in improving healthcare. This general interest role emphasizes collaboration and innovation.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
