We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer will lead the data engineering team, architecting solutions and driving complex data projects to enhance operational data quality and support business decisions.
Top Skills:
AirflowAthenaAWSEmrFlinkHiveKafkaRedshiftSparkSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Design, build and maintain scalable data pipelines, data lake ingestion, and data products. Collaborate with GTM and platform teams to enable self-serve analytics, implement microservices, and process high-volume streaming data using Spark, Airflow and AWS. Drive data modeling, warehousing best practices, and production reliability.
Top Skills:
Amazon EmrAmazon KinesisAmazon RdsAmazon S3Amazon SqsApache AirflowSparkDatabricksJavaPythonScalaSQL
Healthtech
Lead design, build, and maintenance of analytic data warehouse views and pipelines to support HEDIS reporting. Manage analytic discovery platform ingestion, ensure data quality and compliance, troubleshoot complex healthcare data issues, and mentor intermediate contributors while collaborating with IT and analytics stakeholders.
Top Skills:
Analytic Data WarehouseAnalytic Discovery PlatformData PipelinesETLHedisHedis Reporting EngineMS OfficeSASSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
