The Data Engineer will design and maintain data pipelines, optimize workflows, ensure data quality, and implement CI/CD practices using AWS and other tools.
We are looking for an experienced Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong hands-on experience with cloud-based data platforms, big data processing, and analytics engineering best practices.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable data pipelines using AWS EMR, PySpark, and Python
- Work closely with analytics and business teams to build reliable and high-performance data models
- Optimize data processing workflows for performance, reliability, and cost
- Ensure data quality, integrity, and consistency across data platforms
- Implement CI/CD practices for data pipelines using modern DevOps tools
- Collaborate using version control and follow best engineering practices
- Strong experience with AWS (especially EMR)
- Hands-on experience in Python and PySpark
- Strong SQL and analytical skills
- Experience with data pipeline orchestration and tooling
- Working knowledge of GitHub for version control
- Experience with Jenkins or similar CI/CD tools
- Familiarity with dbt
- Experience with Terraform or other Infrastructure-as-Code tools
- Deeper hands-on expertise with dbt
- Exposure to cloud cost optimization and data governance
- Experience working in Agile environments
- Strong communication and stakeholder collaboration skills
BenefitsWhat We Offer
- Opportunity to work on large-scale, modern data platforms
- Collaborative and engineering-driven culture
- Competitive compensation and benefits
Top Skills
Aws Emr
Dbt
Git
Jenkins
Pyspark
Python
SQL
Terraform
Mindera Chennai, Tamil Nadu, IND Office
Murugappa Road, Kotturpuram, Cove Offices, No 12, Chennai, Tamil Nadu, India, 600085
Similar Jobs
Fintech • Financial Services
Build and maintain data architectures and pipelines, design data lakes and warehouses, and collaborate with data scientists to develop solutions.
Top Skills:
AbinitioApache AirflowAthenaAWSDbtGlueLake FormationLambdaPl SqlPysparkS3SnowflakeSQL
Artificial Intelligence • Consulting
As a Data Engineer, you will implement data pipelines and analytics to support decision-making using AWS technologies and Machine Learning.
Top Skills:
Apache AirflowSparkAWSAws GlueAws KinesisAws LambdaAws RedshiftAws S3KafkaNoSQLPythonSQL
Artificial Intelligence • Consulting
As a Data Engineer, implement data pipelines and analytics solutions using AWS technologies, collaborating closely with Product Owners and AWS Architects.
Top Skills:
Apache AirflowSparkAWSAws AthenaAws EmrAws GlueAws KinesisAws LambdaAws MskAws RedshiftAws S3Control MDatabricksJavaNoSQLPysparkPythonScalaSnowflakeSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
