The Azure Data Engineer will build data pipelines and dataflows, implement security modules, and work with Azure services while supporting business requirements and data analysis.
This is a remote position.
Roles & Responsibilities:
- Understand business requirement and actively provide inputs from Data perspective.
- Understand the underlying data and flow of data.
- Build simple to complex pipelines & dataflows.
- Work with other Azure stack modules like Azure Data Lakes, SQL DW, etc.
- Should be able to implement modules that has security and authorization frameworks.
- Recognize and adapt to the changes in processes as the project evolves in size and function.
Requirements
Knowledge, Skills & Abilities:
- Expert level knowledge on Azure Data Factory.
- Expert level knowledge of SQL DB & Data warehouse (e.g. Microsoft SQL Server 2012/2016 & SSIS)
- Should know at least one programming language (e.g. C#, Visual Basic .NET, C++ .NET, PowerShell)
- Should be able to analyse and understand complex data.
- Knowledge of Azure data lake is an added advantage.
- Knowledge of other Azure Services like Analysis Service, SQL Databases will be an added advantage
- Excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision
Similar Jobs
Software
Design, build, and maintain batch and real-time ETL/ELT data pipelines and workflows. Automate ingestion, aggregation and logging; ensure data accuracy, security, and compliance. Implement data warehouse and lake solutions, mentor junior engineers, and collaborate with stakeholders to meet business requirements.
Top Skills:
AdfAdls Gen2AirflowAthenaAWSAws QuicksightAzureAzure Sql DbAzure SynapseBigQueryCassandraData LakesData WarehousesEc2EmrFivetranGCPGlueGlue EtlHadoopHiveIamJavaLambdaMapreduceMatillionMongoDBNeo4JNumpyPandasPower BIPythonRdsRedisRedshiftS3ScalaSnowflakeSparkSQLStitchTableau
Fintech • Financial Services
Design, build, and maintain scalable Azure-based data pipelines and warehouses using ADF, Databricks, Synapse. Optimize performance, ensure security and governance, collaborate with analysts/scientists, automate CI/CD, monitor health, and document architectures and best practices.
Top Skills:
Arm TemplatesAzure Ai & Machine LearningAzure Blob StorageAzure Data FactoryAzure Data LakeAzure DatabricksAzure DevopsAzure MonitorAzure Sql DatabaseAzure Synapse AnalyticsCosmos DbDataopsGitJavaLog AnalyticsPower BIPysparkPythonScalaSparkSQLSQL ServerT-SqlTerraform
Artificial Intelligence • Healthtech • Software • Analytics
As a Data Engineer, you will enhance data pipelines, support ML workflows, and improve cloud infrastructure on Azure and AWS, collaborating with Scientists and Engineers to turn data into actionable insights.
Top Skills:
AWSAzureDatabricksPythonRSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
