Mindera Logo

Mindera

Senior Data Engineer

Posted 16 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Design, build, and optimize scalable AWS-based data platforms and ETL/ELT pipelines using Python, SQL, PySpark, Spark, Glue, and Airflow. Responsibilities include data transformation, workflow orchestration, quality monitoring, performance tuning, production troubleshooting, architecture discussions, code reviews, and establishing engineering standards. The role independently owns projects, resolves complex issues, mentors engineers, and contributes to technical decisions.
The summary above was generated by AI

🚀 Senior Data Engineer – Mindera

At Mindera, we build high-performing, scalable technology solutions that help businesses innovate and grow. We bring together engineering expertise, collaboration, and a passion for technology to deliver impactful solutions.

We are looking for an experienced Data Engineer with strong hands-on expertise in Snowflake, dbt, SQL, Python, and AWS data services. The ideal candidate will have prior experience in Analytics Engineering, with the ability to maintain, optimise, and enhance existing data models and pipelines while contributing to the team's data engineering initiatives.

Role Overview

As a Data Engineer, you will be responsible for designing, developing, maintaining, and optimising data pipelines and analytical data models. You will work extensively with Snowflake, dbt Core/dbt Cloud, SQL, Python, and AWS services to ensure reliable, scalable, and high-quality data transformation workflows.

The ideal candidate will bring strong Analytics Engineering experience and be capable of taking ownership of existing data solutions with minimal ramp-up time.


RequirementsKey Responsibilities
  • Design, develop, and maintain scalable data pipelines and transformation workflows.
  • Build and optimise data models using Snowflake to support analytics and reporting requirements.
  • Manage Snowflake virtual warehouses, optimise queries, and improve performance and compute efficiency.
  • Develop and maintain dbt models using dbt Core and dbt Cloud, including incremental models, macros, and automated testing.
  • Write complex, efficient SQL queries for data transformation, validation, and processing.
  • Develop Python scripts for data engineering, pipeline automation, and workflow management.
  • Work with Snowflake stored procedures and Python-based data processing solutions.
  • Build, maintain, and troubleshoot Apache Airflow DAGs for data pipeline orchestration.
  • Implement and support data ingestion and processing workflows using AWS services, including S3, Glue, and Kinesis Data Firehose.
  • Design and implement dimensional data models, including fact tables, dimension tables, and star/snowflake schemas.
  • Monitor data pipelines, troubleshoot production issues, and ensure data quality, consistency, and reliability.
  • Collaborate with analytics engineers, data engineers, analysts, and other stakeholders to translate business requirements into effective data solutions.
  • Follow best practices for version control, testing, documentation, deployment, and maintainability.
  • Take ownership of existing data workflows and contribute to continuous improvements in pipeline performance and data modelling.
Required Technical Skills

Snowflake

  • Strong hands-on experience with Snowflake data warehousing.
  • Experience with warehouse management, query optimisation, and performance tuning.
  • Knowledge of Snowflake architecture, compute management, and data modelling.

dbt Core and dbt Cloud

  • Strong experience developing and maintaining dbt projects.
  • Hands-on expertise in incremental models, macros, and dbt testing.
  • Understanding of model dependencies, documentation, and deployment workflows.

SQL

  • Advanced SQL skills, including complex joins, CTEs, window functions, and aggregations.
  • Experience optimising queries and processing large datasets.

Python

  • Experience developing Python scripts for data engineering and pipeline automation.
  • Familiarity with Snowflake stored procedures and Python-based integrations.
  • Experience building or maintaining Airflow DAGs.

AWS and Data Pipeline Orchestration

  • Hands-on experience with AWS data services, including:
    • Amazon S3
    • AWS Glue
    • Amazon Kinesis Data Firehose
  • Experience using Apache Airflow for pipeline orchestration, scheduling, and monitoring.
  • Ability to troubleshoot and maintain production data pipelines.

Dimensional Modelling

  • Strong understanding of dimensional modelling principles.
  • Experience designing fact and dimension tables.
  • Knowledge of star and snowflake schemas and analytical data modelling practices.
Experience and Qualifications
  • 8–12 years of overall experience in Data Engineering or related data disciplines.
  • Previous hands-on experience in an Analytics Engineering role is strongly preferred.
  • Proven experience working with Snowflake, dbt, SQL, Python, and AWS data services.
  • Experience maintaining and enhancing production-grade data pipelines and analytical models.
  • Ability to work independently, solve complex technical problems, and take ownership of existing data solutions.
  • Strong communication and collaboration skills.

BenefitsWe offer
  • Flexible working hours (self-managed)
  • Annual bonus, subject to company performance
  • Access to Udemy online training and opportunities to learn and grow within the role

At Mindera we use technology to build products we are proud of, with people we love.

Software Engineering Applications, including Web and Mobile, are at the core of what we do at Mindera.

We partner with our clients, to understand their products and deliver high-performance, resilient and scalable software systems that create an impact on their users and businesses across the world.

You get to work with a bunch of great people, and the whole team owns the project together.

Our culture reflects our lean and self-organisation attitude.

We encourage our colleagues to take risks, make decisions, work in a collaborative way and talk to everyone to enhance communication. We are proud of our work and we love to learn all and everything while navigating through an Agile, Lean and collaborative environment.

Our offices are located: Porto, Portugal | Aveiro, Portugal | Coimbra, Portugal | Leicester, UK | San Diego, USA | Chennai, India | Bengaluru, India

Mindera Chennai, Tamil Nadu, IND Office

Murugappa Road, Kotturpuram, Cove Offices, No 12, Chennai, Tamil Nadu, India, 600085

Similar Jobs

Yesterday
Hybrid
Senior level
Senior level
Blockchain • Database • Analytics
Designs and maintains scalable Databricks ETL/ELT pipelines using Python, PySpark, SQL, Spark, and Delta Lake. Manages Databricks infrastructure, Jobs, Workflows, clusters, access controls, and performance optimization. Implements data governance through Unity Catalog, data quality checks, lineage, metadata management, cataloging, and governed access. Integrates diverse data sources, troubleshoots pipeline issues, supports data security and compliance, and collaborates with teams on enterprise data management practices.
Top Skills: Amazon S3SparkCi/CdDatabricksDelta LakeGitPysparkPythonRest ApisSQLUnity Catalog
6 Days Ago
In-Office
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Natural Language Processing • Consulting
Build, optimize, and scale end-to-end data pipelines using Databricks, SQL, Python, and Spark. Improve ETL/ELT performance, reliability, and cost efficiency; implement data quality, governance, and security practices; troubleshoot distributed data workflows; collaborate with engineers, analysts, and stakeholders; and support cloud data platform migration and modernization initiatives.
Top Skills: SparkAWSAzureDatabricksDatabricks WorkflowsDelta LakeGitJfrog ArtifactoryPythonShell ScriptingSQL
7 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Artificial Intelligence • Healthtech • Information Technology • Other • Analytics
Lead the architecture, development, operation, and optimization of scalable data pipelines and reporting services for Elsevier’s Search and AI Platform. Own AWS infrastructure, data quality, observability, governance, reliability, and performance. Partner with product and engineering teams on technical delivery, mentor engineers, establish software engineering standards, and contribute to broader platform architecture and roadmap decisions.
Top Skills: AirflowApache IcebergAWSAws GlueCi/CdEtl/EltFastapiGitGithub ActionsJavaKafkaPythonRdbmsSnowflakeSparkSpring BootSQLTerraform

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account