The Azure Data Engineer will implement big data pipelines using Azure technologies, collaborate with stakeholders, and utilize tools like Data Factory and Databricks.
This is a remote position.
Description :
- At least 2 years hands on experience working with an Agile data engineering team working on big data pipelines using Azure in a commercial environment.
- Dealing with senior stakeholders/leadership
- Understanding of Azure data security and encryption best practices. [ADFS/ACLs]
- Data Bricks - experience writing in and using data bricks Using Python to transform, manipulate data.
- Data Factory - experience using data factory in an enterprise solution to build data pipelines. Experience calling rest APIs.
- Synapse/data warehouse - experience using synapse/data warehouse to present data securely and to build & manage data models.
- Microsoft SQL server - We- d expect the candidate to have come from a SQL/Data background and progressed into Azure
- PowerBI - Experience with this is preferred
Additionally :
- Experience using GIT as a source control system
- Understanding of DevOps concepts and application
- Understanding of Azure Cloud costs/management and running platforms efficiently
Requirements
- 3 to 6 years of experience.
- Must Have: Azure services like Azure Data Factory, Databricks, Azure Data lakes, Synapse/DW. and SQL
- Good to have: Python, PowerBI, Git
Similar Jobs
Artificial Intelligence • Healthtech • Software • Analytics
As a Data Engineer, you will enhance data pipelines, support ML workflows, and improve cloud infrastructure on Azure and AWS, collaborating with Scientists and Engineers to turn data into actionable insights.
Top Skills:
AWSAzureDatabricksPythonRSQL
Artificial Intelligence • Big Data • Information Technology • Consulting
The Azure Data Engineer will build data pipelines and dataflows, implement security modules, and work with Azure services while supporting business requirements and data analysis.
Top Skills:
Azure Data FactoryAzure Data LakeC#C++ .NetMicrosoft Sql Server 2012Microsoft Sql Server 2016PowershellSql DatabaseSsisVisual Basic .Net
Fintech • Financial Services
The Data Engineer will design, develop, and maintain data pipelines and solutions, ensuring data quality and collaborating with cross-functional teams to meet analytics needs.
Top Skills:
Apache AirflowSparkAWSAzureDockerDynamoDBGCPGitHadoopJavaJenkinsKafkaKubernetesLuigiMongoDBMySQLNode.jsPostgresPythonTerraform
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
