We are looking for a Data Engineer with skills in Python, SQL, and Azure technologies to develop Big Data applications. Responsibilities include working with Spark and Docker to handle large scale data processing and analytics.
This is a remote position.
- Must have - Python, SQL, Spark, Databricks, Azure Data Factory, Azure Synapse, Docker
- Good to have - Knowledge of Teradata, Airflow, AWS, GC
- experience in developing Big Data applications
- Experience in large-scale Big Data & Analytics applications
- Hands on experience in using technologies like Spark, Scala,
- Experience in Azure & Docker are added advantage.
- Strong problem-solving skills, data structures and algorithms
- Experience with distributed systems handling large amounts of data.
Requirements
- Immediate Joiner
- Remote location
- Data Engineer with 2 to 6 Yrs of experience
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
Cloud • Security • Software • Cybersecurity • Automation
Lead architecture and implementation of GitLab's in-product insights and Data Marketplace. Design and coordinate ingestion, modeling, and synchronization into the Knowledge Graph; integrate external systems; publish observability data; define operational readiness; translate ambiguous product problems into technical plans; resolve cross-team dependencies; and mentor other engineers.
Top Skills:
BigQueryData Insights PlatformDatabricksGoJIRAKnowledge GraphNode.jsOpentelemetryRubyServicenowSnowflakeZendesk
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead design and implementation of search and data systems, define architecture and roadmap, mentor engineers, collaborate cross-functionally to deliver scalable, reliable data and search features, and drive technical strategy.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
