InOrg Global Logo

InOrg Global

Data Architect- Databricks

Job Posted 13 Days Ago Posted 13 Days Ago
Be an Early Applicant
India
Senior level
India
Senior level
Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
The summary above was generated by AI

Job Title: Data Architect – Databricks
Company: V4C.ai
Type: Full-time
Experience Level: Senior
We're seeking a skilled Data Architect with hands-on Databricks experience to help build robust pipelines and support scalable analytics and machine learning initiatives.
Key Responsibilities

  • Databricks Solution Architecture: Design and implement scalable, secure, and efficient Databricks solutions that meet client requirements.
  • Data Engineering: Develop data pipelines, architect data lakes, and implement data warehousing solutions using Databricks.
  • Data Analytics: Collaborate with data scientists and analysts to develop and deploy machine learning models and analytics solutions on Databricks.
  • Performance Optimization: Optimize Databricks cluster performance, ensuring efficient resource utilization and cost-effectiveness.
  • Security and Governance: Implement Databricks security features, ensure data governance, and maintain compliance with industry regulations.
  • Client Engagement: Work closely with clients to understand their business requirements, provide technical guidance, and deliver high-quality Databricks solutions.
  • Thought Leadership: Stay up to date with the latest Databricks features, best practices, and industry trends, and share knowledge with the team.

Requirements

  • Databricks Experience: 5+ years of experience working with Databricks, including platform architecture, data engineering, and data analytics.
  • Technical Skills: Proficiency in languages such as Python, Scala, or Java, and experience with Databricks APIs, Spark, and Delta Lake.
  • Data Engineering: Strong background in data engineering, including data warehousing, ETL, and data governance.
  • Leadership: Proven experience leading technical teams, mentoring junior engineers, and driving technical initiatives.
  • Communication: Excellent communication and interpersonal skills, with the ability to work effectively with clients and internal stakeholders.

Good to Have

  • Certifications: Databricks Certified Professional or similar certifications.
  • Cloud Experience: Experience working with cloud platforms such as AWS, Azure, or GCP.
  • Machine Learning: Knowledge of machine learning concepts and experience with popular ML libraries

Top Skills

AWS
Azure
Databricks
Databricks Apis
Delta Lake
GCP
Java
Python
Scala
Spark

Similar Jobs

14 Days Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Expert/Leader
Expert/Leader
Fintech • Information Technology • Payments
The Lead Data Engineer will develop and implement the vision for a DataPlatform, leading architecture and design to support business strategies, while providing technical guidance and ensuring best practices in data governance and security.
Top Skills: Aws AthenaAws EmrDatabricksGcp Dataproc
10 Days Ago
In-Office or Remote
4 Locations
Senior level
Senior level
Cloud • Information Technology • Software
The Data Architect will design scalable data architectures on Databricks, lead data migration initiatives, and define data governance frameworks.
Top Skills: AlationSparkAWSAzureAzure DevopsCloudFormationCollibraDatabricks Unity CatalogDelta LakeDockerGCPGithub ActionsJenkinsKubernetesNoSQLPulumiPythonScalaSQLTerraform
7 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Manage Oracle databases, design automated infrastructure solutions, mentor staff, and develop CI/CD pipelines. Ensure database security and performance tuning.
Top Skills: Active Data GuardAixAnsibleAzure DevopsCloud (AzureData PumpElasticLinuxOci)OemOidOraclePythonRmanServicenowSqlplusTerraform

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account