Lead modernization of a large-scale AWS data platform: design, build, and optimize scalable ETL/ELT pipelines, migrate Airflow/EMR to AWS-native services (Glue, MWAA), implement data lake/warehouse solutions, enforce data governance/lineage/metadata, build data quality and monitoring frameworks, automate deployments with IaC, and support BI (QuickSight) and Power BI migration, UAT, and production support.
About us:
Working at Tech Holding isn't just a job, it's an opportunity to be a part of something bigger. We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-quality solutions to our clients. Our founders and team members have industry experience and have held senior positions in a wide variety of companies – from emerging startups to large Fortune 50 firms – and we have taken our combined experiences and developed a unique approach that is supported by the principles of deep expertise, integrity, transparency, and dependability.
About the Role
We are looking for a Senior AWS Data Engineer to join our team and lead the modernization of a large-scale cloud data platform. You will be responsible for designing, building, and optimizing scalable data pipelines, modernizing ETL/ELT workloads, implementing data governance, and enabling analytics and reporting solutions on AWS.
The ideal candidate has deep expertise in AWS data services, data engineering, pipeline orchestration, and data warehouse modernization, with a passion for building reliable, secure, and scalable data platforms.
Location: Remote
Experience Required: 5+ Years
Employment Type: Contract
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on AWS.
- Modernize legacy data platforms by migrating Apache Airflow/MWAA workloads to AWS-native orchestration services.
- Migrate and optimize Amazon EMR workloads to AWS Glue.
- Design and implement scalable data lake and data warehouse solutions using AWS services.
- Develop robust data models, semantic layers, and standardized KPI definitions to support business analytics.
- Build and maintain data quality, validation, anomaly detection, and monitoring frameworks.
- Implement metadata management, data lineage, and data governance best practices.
- Develop automated deployment pipelines and infrastructure using Infrastructure as Code (IaC).
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Collaborate with business stakeholders to understand reporting requirements and translate them into scalable data solutions.
- Support QuickSight semantic datasets, dashboard optimization, and Power BI migration initiatives.
- Participate in UAT, production deployments, knowledge transfer, and post-production support.
Required Skills & Qualifications
• 5+ years of experience in Data Engineering.
• Strong programming skills in Python and SQL.
• Hands-on experience with Apache Spark / PySpark.
• Extensive experience with AWS data services including:
- AWS Glue
- Amazon S3
- Amazon Redshift
- Amazon Athena
- AWS Lambda
- AWS Step Functions
- Amazon EventBridge
- AWS IAM
• Experience designing and implementing ETL/ELT pipelines.
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
• Strong knowledge of data modeling, data warehousing, and data lake architecture.
• Experience with Apache Airflow or Amazon MWAA.
• Strong understanding of Data Governance, Metadata Management, Business Glossary, and Data Lineage.
• Experience implementing Data Quality, Audit Logging, and Data Reconciliation frameworks.
• Experience with Amazon QuickSight, semantic datasets, and BI reporting.
• Experience with Git, CI/CD, and Infrastructure as Code (Terraform or CloudFormation).
• Excellent analytical, troubleshooting, and communication skills.
Preferred Qualifications
- Experience with Power BI migration projects.
- Experience working with Healthcare or Life Sciences data platforms.
- Knowledge of Lake Formation, AWS Glue Data Catalog, and AWS security best practices.
- Familiarity with ML-ready data pipelines and feature engineering.
- AWS Certification (Data Engineer, Solutions Architect, or Developer) is a plus.
Tech Holding is proud to be an Equal Opportunity Employer and is committed to fostering a diverse and inclusive workplace. We welcome applicants from all backgrounds and experiences, and we consider qualified applicants without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic. If you require accommodation in the application process, please contact our HR
Similar Jobs
Cloud • Information Technology • Productivity • Software • Automation
As a Technical Architect, lead the development of enterprise solution architectures, design integration solutions, and ensure best practices for Boomi products.
Top Skills:
Ai AutomationArchimateAWSAzureBoomi AtomsphereCobitDockerGCPGroovyJavaJavaScriptJSONKubernetesLlmsNoSQLRagRestSafeSoapSQLTogafXMLZachman
Cloud • Information Technology • Productivity • Software • Automation
The Technical Architect leads the development of enterprise solution architecture, evaluating integration requirements, providing infrastructure recommendations, and promoting best practices for Boomi products.
Top Skills:
ArchimateAtomsphere Integration PlatformAWSAzureCobitDockerGCPGroovyJavaJavaScriptJmsKubernetesMdh Master Data ManagementNoSQLSafeSQLTogafZachman
Cloud • Information Technology • Productivity • Software • Automation
The Reporting and Analytics Advisor is responsible for managing reporting, dashboards, and data visualization for internal clients, utilizing Power BI and SQL to create impactful analytics and streamline data processes.
Top Skills:
DaxPower BISnowflake Data CloudSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
