The Data Engineer role involves analyzing raw data, building data systems, conducting complex analyses, and enhancing data quality by collaborating with data scientists and architects.
This is a remote position.
Responsibilities:
Requirements
Requirements and skills:
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
Cloud • Security • Software • Cybersecurity • Automation
Lead architecture and implementation of GitLab's in-product insights and Data Marketplace. Design and coordinate ingestion, modeling, and synchronization into the Knowledge Graph; integrate external systems; publish observability data; define operational readiness; translate ambiguous product problems into technical plans; resolve cross-team dependencies; and mentor other engineers.
Top Skills:
BigQueryData Insights PlatformDatabricksGoJIRAKnowledge GraphNode.jsOpentelemetryRubyServicenowSnowflakeZendesk
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead design and implementation of search and data systems, define architecture and roadmap, mentor engineers, collaborate cross-functionally to deliver scalable, reliable data and search features, and drive technical strategy.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
