Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
Job Summary:
We're seeking an experienced Data Architect / Senior Data Architect/ Associate Data ArchitectExpertise in data engineering across major data platforms. The ideal candidate will have a
strong background in Python, SQL, ETL, and data modeling, with experience in tools like
Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud
knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and
upskill into Databricks & AI/ML projects.
Key Responsibilities:
● Design, develop, and maintain large-scale data systems
● Develop and implement ETL processes using various tools and technologies
● Collaborate with cross-functional teams to design and implement data models
● Work with big data tools like Hadoop, Spark, PySpark, and Kafka
● Develop scalable and efficient data pipelines
● Troubleshoot data-related issues and optimize data systems
● Transition and upskill into Databricks & AI/ML projects
Requirements:
● Relevent experience in data engineering
● Strong proficiency in Python, SQL, ETL, and data modeling
● Experience with one or more of the following:
○ Teradata
○ Informatica
○ Hadoop
○ Spark
○ PySpark
○ ADF
○ Snowflake
○ Big Data
○ Scala
○ Kafka
● Cloud knowledge (AWS, Azure, or GCP) is a plus
● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML
Nice to Have:
● Experience with Databricks
● Knowledge of AI/ML concepts and tools
● Certification in relevant technologies
What We Offer:
● Competitive salary and benefits
● Opportunity to work on cutting-edge projects
● Collaborative and dynamic work environment
● Professional growth and development opportunities
● Remote work opportunities & flexible hours
Top Skills
AWS
Azure
Databricks
Databricks Apis
Delta Lake
GCP
Java
Python
Scala
Spark
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Deliver data modelling and analysis within agile teams for financial services transformation. Elicit and translate business requirements, create/maintain conceptual, logical and physical data models, manage metadata, and support stakeholders and development teams to deliver reconciliation solutions.
Top Skills:
Sql,Ms Office,Gcp Bigquery,Erwin,Visual Paradigm
Cloud • Information Technology • Security • Software • Cybersecurity
Provide second-line support to debug complex security and networking issues, collaborate with Engineering to reproduce and resolve incidents, document solutions in the knowledgebase, analyze trends to drive product improvements, and contribute to product and code changes through customer use-case insight.
Top Skills:
Azure,Aws,Vpc,Vnet,Hybrid Connectivity,Nsg,Nacl,Elb,Gwlb,Terraform
Cloud • Information Technology • Security • Software • Cybersecurity
Provide second-line support for complex security and network incidents, collaborate with engineering to reproduce and resolve issues, document resolutions in the knowledge base, analyze trends to inform product improvements, and assist customers with testing and troubleshooting.
Top Skills:
Azure,Aws,Vpcs,Vnets,Hybrid Connectivity,Nsgs,Nacls,Elb,Gwlb,Terraform,Gcp,Web Proxy,Ssl Inspection,Firewall,Zero Trust,Zia,Zpa,Linux,Windows Server,Azure Virtual Desktop,Citrix
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
