Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
Job Summary:
We're seeking an experienced Data Architect / Senior Data Architect/ Associate Data ArchitectExpertise in data engineering across major data platforms. The ideal candidate will have a
strong background in Python, SQL, ETL, and data modeling, with experience in tools like
Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud
knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and
upskill into Databricks & AI/ML projects.
Key Responsibilities:
● Design, develop, and maintain large-scale data systems
● Develop and implement ETL processes using various tools and technologies
● Collaborate with cross-functional teams to design and implement data models
● Work with big data tools like Hadoop, Spark, PySpark, and Kafka
● Develop scalable and efficient data pipelines
● Troubleshoot data-related issues and optimize data systems
● Transition and upskill into Databricks & AI/ML projects
Requirements:
● Relevent experience in data engineering
● Strong proficiency in Python, SQL, ETL, and data modeling
● Experience with one or more of the following:
○ Teradata
○ Informatica
○ Hadoop
○ Spark
○ PySpark
○ ADF
○ Snowflake
○ Big Data
○ Scala
○ Kafka
● Cloud knowledge (AWS, Azure, or GCP) is a plus
● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML
Nice to Have:
● Experience with Databricks
● Knowledge of AI/ML concepts and tools
● Certification in relevant technologies
What We Offer:
● Competitive salary and benefits
● Opportunity to work on cutting-edge projects
● Collaborative and dynamic work environment
● Professional growth and development opportunities
● Remote work opportunities & flexible hours
Similar Jobs
Enterprise Web • Mobile • Professional Services • Software
Build and improve production LLM agents and AI features through evaluation, experimentation, observability, prompting, context engineering, tool use, and workflow design. Develop backend services, APIs, data models, and feedback pipelines that make agent behavior reliable and measurable. Investigate performance issues, run staged rollouts and production replays, define quality standards, and partner with Product, Data Science, and Sales to deliver business outcomes with appropriate privacy, security, and human-oversight safeguards.
Top Skills:
Agentic WorkflowsAPIsBackend ServicesBraintrustClaude CodeCursorData ModelsDatadog Llm ObservabilityEvaluation HarnessesGithub CopilotLangchainLanggraphLangsmithLlm-As-JudgeLlm-Based SystemsMcp
Enterprise Web • Mobile • Professional Services • Software
Own the AI product roadmap from discovery through launch and iteration. Define model evaluation standards, failure modes, rollback plans, and agent-autonomy boundaries. Prototype and ship production AI features, influence architecture, and apply prompting and context design. Collaborate with Design, Research, Engineering, Sales, Marketing, and Customer Success while tracking quality, latency, cost, adoption, and growth metrics.
Top Skills:
AIBraintrustClaudeCodexCursorLangsmithLlmsOpenclaw
Enterprise Web • Mobile • Professional Services • Software
Build and own full-stack product features from ambiguous problems through deployment. Partner with Product and Design, make UX decisions, integrate LLM and agent capabilities into trustworthy product experiences, talk with users, instrument releases, and iterate based on usage. The role requires strong product judgment, user empathy, independent execution, and comfort using AI coding tools while collaborating with AI engineers on model behavior.
Top Skills:
Claude CodeCursorGithub CopilotLlm AgentsLlm ApisPrompting
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
