Design and optimize scalable data pipelines and analytics platforms using Snowflake, Airflow, and SQL. Ensure data quality and drive performance optimization.
We’re seeking a Data Engineer with strong Snowflake, Airflow, and SQL expertise to design, build, and optimize scalable data pipelines and analytics platforms. You will own end-to-end ELT/ETL workflows, ensure data quality and reliability, and drive continuous performance and cost optimization. Key Responsibilities Build and maintain ELT/ETL pipelines in Airflow (DAGs, scheduling, monitoring). Design and optimize Snowflake data models, warehouses, and transformations. Write high-quality SQL for complex transformations and analytics use cases. Implement data quality checks, observability, and SLAs/alerts. Optimize performance and cost (warehouses, micro-partitions, clustering, resource monitors). Collaborate with analytics, product, and platform teams; document and automate. Required Qualifications Advanced SQL (CTEs, window functions, performance tuning). Snowflake hands-on (virtual warehouses, stages, external tables, Snowpipe, Streams & Tasks, Time Travel, cloning, RBAC). Airflow 2.x (TaskFlow API, operators/sensors, retries, XComs, DAG best practices). Python for pipeline orchestration and Airflow development. Experience with at least one cloud (AWS, GCP, or Azure) object storage and IAM. CI/CD and version control (Git), code reviews, and environment management. Nice to Have dbt, Terraform/IaC, Docker/Kubernetes for Airflow. Streaming/CDC (Kafka, Kinesis, Pub/Sub, Fivetran, Debezium). Data observability (e.g., Great Expectations), lineage/governance, masking/row access policies. Cost governance and security best practices (PII handling, encryption, compliance).
Hexaware Technologies Chennai, Tamil Nadu, IND Office
MCN Nagar Ext, MCN Nagar Extension, Thoraipakkam, Chennai, Tamil Nadu, India, 600097
Similar Jobs
Information Technology • Consulting
Design, build, and optimize scalable data pipelines and analytics solutions on Snowflake. Collaborate with teams for data products and enforce security and governance.
Top Skills:
SnowflakeSQL
Information Technology • Consulting
The role requires leading big data projects with hands-on experience in Azure Databricks, Pyspark coding, advanced SQL, and data warehouse management.
Top Skills:
Azure DatabricksPysparkPythonSQL
Information Technology • Consulting
Design and optimize data pipelines using Azure Databricks and Spark, ensuring data reliability and quality through ETL/ELT workflows and CI/CD automation.
Top Skills:
APIsAzure Data LakeAzure DatabricksPysparkScalaSparkSql DatabaseSynapse
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
