The Principal Data Engineer leads a data team, focuses on resource management, and ensures compliance with data practices while fostering career growth and solving data issues.
Job Title: Principal Data Engineer, Logistics
Employment Type: Full Time
Experience: 12+ Years
About the Role:
We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking.
You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment.
Responsibilities
- Collaborate with business and technology stakeholders to gather and understand data needs
- Translate functional requirements into scalable and maintainable data architecture
- Design and implement robust data pipelines
- Lead data modeling, transformation, and performance optimization efforts
- Ensure data quality, validation, and consistency
- Participate in Agile ceremonies including sprint planning and backlog grooming
- Support CI/CD automation for data pipelines and integration workflows
- Mentor junior engineers and promote best practices in data engineering
Must Have
- 12+ years of IT experience, with at least 5 years in data architecture roles in modern metadata driven and cloud-based technologies, bringing a software engineering mindset
- Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production issues
- Excellent communication skills, with experience in leading client-facing discussion
- Strong hands-on experience with Azure Data Factory and Databricks, leveraging custom solutioning and design beyond drag-and-drop capabilities for big data workloads
- Demonstrated proficiency in SQL, Python, and Spark
- Experience with CI/CD pipelines, version control and DevOps tools
- Experience with applying dimensional and Data Vault methodologies
- Background in working with Agile methodologies and sprint-based delivery
- Ability to produce clear and comprehensive technical documentation
Nice to Have
- Experience with Azure Synapse and Power BI
- Experience with Microsoft Purview and/or Unity Catalog
- Understanding of Data Lakehouse and Data Mesh concepts
- Familiarity with enterprise data governance and quality frameworks
- Manufacturing experience within the operations domain
Top Skills
Azure
Azure Data Factory
Azure Devops
Power BI
Python
Servicenow
SQL
Ssis
Synapse
Encora Chennai, Tamil Nadu, IND Office
No. 11, Doxa Business Center, Rattha Tek Tower, MR Road Thoraipakkam , Chennai, India, 600097
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Responsible for developing scalable software applications including cloud and web applications, mentoring peers, and participating in design reviews and scrum meetings.
Top Skills:
.NetAngularAzureNode.jsPythonReactSQLTypescript
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
The Cyber Security Analyst monitors, detects, and responds to cybersecurity incidents, using various tools to ensure the security of digital assets.
Top Skills:
EdrIdsIpsPalo Alto Cortex XsiamQradarSIEMSplunkThreat Intelligence
Software
As a Senior Software Engineer, you'll build scalable applications, collaborate with teams, improve code quality, and develop features for customer satisfaction.
Top Skills:
AWSJavaJavaScriptMongoDBMySQLPostgresReactRestful ApisSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
