Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and operate scalable ETL/ELT pipelines using PySpark and AWS data services. Orchestrate workflows with Apache Airflow, implement AWS Glue jobs and Data Catalog, manage Lake Formation permissions, publish datasets for BI, and deliver QuickSight visualizations while ensuring data quality and performance.
Top Skills:
Pyspark,Apache Airflow,Aws Glue,Aws Lake Formation,Aws Glue Data Catalog,Amazon Quicksight
Fintech • Financial Services
Build and maintain data architectures and pipelines, design data lakes and warehouses, and collaborate with data scientists to develop solutions.
Top Skills:
AbinitioApache AirflowAthenaAWSDbtGlueLake FormationLambdaPl SqlPysparkS3SnowflakeSQL
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Lead the development of Ab Initio applications at TransUnion, ensuring adherence to best practices and guiding junior developers.
Top Skills:
Ab InitioCi/CdHadoopJenkinsLinux
We are looking for an experienced Data Engineer to design, build, and optimize scalable data pipelines and analytics solutions. The ideal candidate will have strong hands-on experience with cloud-based data platforms, big data processing, and analytics engineering best practices.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable data pipelines using AWS EMR, PySpark, and Python
- Work closely with analytics and business teams to build reliable and high-performance data models
- Optimize data processing workflows for performance, reliability, and cost
- Ensure data quality, integrity, and consistency across data platforms
- Implement CI/CD practices for data pipelines using modern DevOps tools
- Collaborate using version control and follow best engineering practices
- Strong experience with AWS (especially EMR)
- Hands-on experience in Python and PySpark
- Strong SQL and analytical skills
- Experience with data pipeline orchestration and tooling
- Working knowledge of GitHub for version control
- Experience with Jenkins or similar CI/CD tools
- Familiarity with dbt
- Experience with Terraform or other Infrastructure-as-Code tools
- Deeper hands-on expertise with dbt
- Exposure to cloud cost optimization and data governance
- Experience working in Agile environments
- Strong communication and stakeholder collaboration skills
BenefitsWhat We Offer
- Opportunity to work on large-scale, modern data platforms
- Collaborative and engineering-driven culture
- Competitive compensation and benefits
Mindera Chennai, Tamil Nadu, IND Office
Murugappa Road, Kotturpuram, Cove Offices, No 12, Chennai, Tamil Nadu, India, 600085
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
