Design and implement ETL/ELT pipelines using Azure Databricks and ADF. Analyze data, apply data warehouse concepts and complex SQL, provide technical expertise to stakeholders, work independently within Agile teams, and respond to client data questions and insights.
JD Azure Databricks :
• Analyse the data in ADF and provides tool based technical expertise to the team members
• Expert in designing ETL /ELT using market latest technology with minimum guidance
• Good in DW concepts, Complex SQL and communication
• Works with multiple stakeholders and workstreams to provide expertise in data management
• Independently owns the assigned task
• Agile execution methodology
• Respond to client questions around the data and insights
• Years of Experience : 4-8
Indium Chennai, Tamil Nadu, IND Office
No.64 (Old N.143), Eldams Road, Ganesh Chambers, Teynampet, Chennai, Tamil Nadu, India, 600 018
Similar Jobs
Information Technology • Consulting
Designs, develops, and maintains scalable Databricks data pipelines and Apache Spark processing solutions. Builds ETL/ELT workflows, implements data lake and warehouse architectures, integrates cloud data services, optimizes pipeline and Spark performance, and supports data governance, quality, security, and reliability. Collaborates with data scientists, analysts, engineers, and business stakeholders while documenting architectures and operational processes.
Top Skills:
Amazon Web ServicesSparkDatabricksGoogle Cloud PlatformAzurePythonScalaSQL
Big Data • Information Technology
Design, build, and maintain automated test frameworks and suites for UI, API, and backend layers using Python/Java, Playwright/Selenium, TestNG, and SQL. Execute manual and automated tests, integrate tests into CI/CD pipelines, deploy via DevOps tools, and collaborate with cross-functional Agile teams to improve quality and monitoring.
Top Skills:
BitbucketCi/CdDatabricksDockerGitJavaJenkinsJmeterKubernetesLoadrunnerAzurePlaywrightPysparkPythonSeleniumSQLTestng
Big Data • Information Technology
Design, build and maintain scalable automation frameworks and test suites for cloud/big-data systems. Implement automated and manual tests across UI, services, APIs and performance; deploy via CI/CD; collaborate with cross-functional teams and provide technical guidance.
Top Skills:
AirflowDatabricksHiveMachine LearningNoSQLPostgresPysparkPythonSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
