Design, develop, and modernize enterprise-scale Azure data platforms. Lead solution architecture, refactor and optimize PySpark/Databricks pipelines, implement ETL/ELT and lakehouse/warehousing solutions, ensure performance, data quality, governance, and mentor junior engineers.
Enable Data seeking an experienced Azure Data Architect with strong hands-on engineering expertise to design, develop, optimize, and modernize enterprise-scale data platforms. The role combines solution architecture, technical leadership, and individual contributor responsibilities, requiring deep expertise in Azure data services, data engineering best practices, and large-scale data processing using PySpark, Python, SQL, and Azure Databricks.
The ideal candidate will be responsible for analyzing existing data products and pipelines, identifying improvement opportunities, leading refactoring and redesign initiatives, and implementing scalable, reliable, and high-performance data solutions on Azure.
Responsibilities- Architecture & Solution Design
- Overall 15+ years of experience with 10+ years of experience in Data Engineering and Analytics solutions.
- Design end-to-end data architectures on Microsoft Azure.
- Define data ingestion, transformation, storage, governance, and consumption strategies.
- Create scalable, secure, and cost-effective data solutions aligned with business objectives.
- Establish architectural standards, design patterns, and best practices for data engineering teams.
- Collaborate with business stakeholders, product owners, and technical teams to translate requirements into technical solutions.
- Design, develop, and modernize enterprise data platforms on Azure. Analyze, refactor, and redesign existing data pipelines and products while building new scalable data solutions.
- Act as a hands-on individual contributor with technical leadership responsibilities, including mentoring junior developers and driving best practices.
- Strong hands-on experience in PySpark, Python, and SQL
- Expertise in Azure Databricks and Azure data ecosystem
- Experience designing and implementing scalable data architectures
- Ability to analyze, optimize, refactor, and redesign existing data pipelines
- Develop and maintain ETL/ELT solutions and data products
- Performance tuning, troubleshooting, and data quality implementation
- Mentor and guide junior developers and conduct code reviews
- Collaborate with cross-functional teams to deliver end-to-end data solutions
Required Experience
Requirements
- Azure Data Lake, Azure Data Factory, Azure Synapse
- Data warehousing, lakehouse architecture, and cloud migration
- CI/CD, Git, and Agile development practices
- Role Type: Senior Individual Contributor with Technical Leadership responsibilities.
Similar Jobs
Cloud • Information Technology • Productivity • Software • Automation
As a Technical Architect, lead the development of enterprise solution architectures, design integration solutions, and ensure best practices for Boomi products.
Top Skills:
Ai AutomationArchimateAWSAzureBoomi AtomsphereCobitDockerGCPGroovyJavaJavaScriptJSONKubernetesLlmsNoSQLRagRestSafeSoapSQLTogafXMLZachman
Cloud • Information Technology • Productivity • Software • Automation
The Technical Architect leads the development of enterprise solution architecture, evaluating integration requirements, providing infrastructure recommendations, and promoting best practices for Boomi products.
Top Skills:
ArchimateAtomsphere Integration PlatformAWSAzureCobitDockerGCPGroovyJavaJavaScriptJmsKubernetesMdh Master Data ManagementNoSQLSafeSQLTogafZachman
Cloud • Information Technology • Productivity • Software • Automation
The Reporting and Analytics Advisor is responsible for managing reporting, dashboards, and data visualization for internal clients, utilizing Power BI and SQL to create impactful analytics and streamline data processes.
Top Skills:
DaxPower BISnowflake Data CloudSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
