Kavi Software Technologies Private Limited (Kavi Global) Logo

Kavi Software Technologies Private Limited (Kavi Global)

Senior ETL Data Engineer

Posted Yesterday
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Designs, builds, optimizes, and monitors scalable ETL/ELT pipelines, data models, warehouses, and lakes. Develops Power BI datasets, DAX measures, semantic layers, refresh pipelines, and performance optimizations. Ensures data quality, governance, security, and row-level security while supporting CI/CD releases and production troubleshooting. Partners with BI and business stakeholders, mentors junior engineers, and establishes data engineering best practices.
The summary above was generated by AI

Senior ETL Data Engineer
Experience:
8 - 10 years | Level: Senior

About the Role
 We're looking for a Senior ETL Data Engineer to design, build, and optimize scalable data pipelines that power analytics, reporting, and machine learning initiatives across the organization. You'll own the full lifecycle of data pipeline development — from ingestion to transformation to delivery — while also enabling downstream BI consumption through well-structured, reporting-ready datasets. You'll mentor junior engineers and drive best practices in data engineering.

Key Responsibilities

      Design, develop, and maintain robust, scalable ETL/ELT pipelines to ingest data from diverse sources (databases, APIs, flat files, streaming sources)

      Build and optimize data models (star/snowflake schemas) for data warehouses and data lakes, structured for efficient BI consumption

      Own end-to-end pipeline orchestration, monitoring, and error handling to ensure high reliability and data quality

      Optimize SQL queries and pipeline performance for large-scale datasets

      Partner with BI developers and business stakeholders to design semantic layers and datasets that support Power BI dashboards and reports

      Build and maintain Power BI data models (star schema), DAX measures, and dataset refresh pipelines, ensuring alignment with underlying ETL structures

      Optimize Power BI datasets and queries for performance, including incremental refresh strategies and efficient data source connections (Import vs. DirectQuery)

      Implement data quality checks, validation frameworks, and observability/monitoring for pipelines

      Manage and evolve CI/CD practices for data pipeline (and where applicable, Power BI deployment pipeline) releases

      Ensure data governance, security, and row-level security (RLS) standards are met across pipelines and Power BI reports

      Mentor junior data engineers and contribute to engineering best practices and documentation

      Troubleshoot and resolve production pipeline and reporting issues, ensuring minimal downtime

 

Required Skills & Qualifications

      8-10 years of hands-on experience in data engineering with a strong focus on ETL/ELT pipeline development

      Strong proficiency in SQL and at least one programming language (Python preferred)

      Hands-on experience with ETL/orchestration tools such as Apache Airflow, dbt, Informatica, Talend, or SSIS

      Solid experience with cloud data platforms (AWS Redshift/Glue, Azure Data Factory/Synapse, or GCP BigQuery/Dataflow)

      Experience working with both relational databases (PostgreSQL, MySQL, SQL Server) and big data technologies (Spark, Hadoop, Hive)

      Strong understanding of data warehousing concepts, dimensional modeling, and data architecture principles

      Working knowledge of Power BI — building data models, writing DAX, and designing dashboards/reports connected to enterprise data pipelines

      Understanding of Power BI performance optimization (incremental refresh, aggregations, query folding, Import vs. DirectQuery trade-offs)

      Experience with data pipeline orchestration, scheduling, and monitoring frameworks

      Familiarity with version control (Git) and CI/CD pipelines for data engineering workflows

 

 

 



Similar Jobs

5 Hours Ago
In-Office
Chennai, Tamil Nadu, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Owns the architecture, engineering standards, and technology roadmap for a secure healthcare data platform across AWS, Azure, and Databricks. Designs ingestion, lakehouse, interoperability, governance, privacy, analytics, and operational reporting solutions. Establishes standards for Spark, Python, SQL, data quality, observability, metadata, CI/CD, infrastructure as code, and disaster recovery. Leads healthcare data interoperability, security architecture, proofs of concept, performance assessments, technical roadmaps, and executive decision support.
Top Skills: Amazon EventbridgeAmazon S3Apache IcebergSparkAthenaAuto LoaderAWSAws LambdaAws Secrets ManagerAws Step FunctionsAzureCi/CdClinical NlpCloudwatchCptDatabricksDatabricks SqlDatabricks WorkflowsDelta LakeEcsEksFhir R4Hl7 V2Icd-10Infrastructure As CodeJSONKmsLlmsLoincMlopsNdjsonOmop CdmPysparkPythonRxnormSnomed CtSnowflakeSQLSreTrinoUnity CatalogXML
21 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Digital Media • Information Technology • News + Entertainment
Designs, develops, and optimizes scalable data pipelines and structures for analytics and downstream apps. Implements SQL transformations, ingestion frameworks, cloud data solutions (Snowflake, Databricks), ensures data quality, lineage, and governance, and mentors junior engineers while improving internal tools and automation.
Top Skills: AirflowSparkAWSAws S3AzureCi/CdDatabricksDbtGCPIcebergPythonSnowflakeSQL
21 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Digital Media • Information Technology • News + Entertainment
Implements, refines, validates, trains, and deploys machine learning models for company products. Designs and monitors data pipelines, evaluates internal and external ML solutions, documents technical requirements, and develops proof-of-concept strategies. Conducts case studies, contributes to research, patents, APIs, and intellectual property, and provides recommendations to support future product development. Requires independent judgment and availability for variable schedules, including nights and weekends.
Top Skills: APIsData PipelinesMachine Learning

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account