Designs, builds, and maintains scalable data pipelines, ETL processes, data architectures, and integrations. Ensures data quality, governance, security, compliance, and accessibility while monitoring performance and troubleshooting issues. Collaborates with data scientists, analysts, and engineers to define requirements and deliver reliable solutions. Participates in code reviews, documentation, data modeling, schema design, and CI/CD implementation for data workflows.
We
are seeking a detail-oriented and highly motivated Data Engineer to join our
growing Data & Analytics team.
In this role, you will be responsible for designing, building, and maintaining
robust data pipelines and infrastructure that power insights across the
organization. You’ll work closely with data scientists, analysts, and engineers
to ensure the integrity, accessibility, and scalability of our data systems.
Key
Responsibilities:
- Design, develop, and maintain scalable
data pipelines and ETL processes.
- Build and optimize data architecture to
ensure data quality and consistency.
- Integrate data from diverse internal
and external sources.
- Collaborate with cross-functional teams
to define data requirements and deliver solutions.
- Implement best practices for data
governance, security, and compliance.
- Monitor pipeline performance and
perform real-time troubleshooting of data issues.
- Participate in code reviews and
contribute to documentation and standards.
Required
Qualifications & Skills:
- Bachelor’s degree in computer science,
Engineering, or a related field (or equivalent practical experience).
- 5+ years of professional experience in
data engineering.
- Solid understanding of SQL and
proficiency in at least one programming language, such as Python, Java, or
Scala.
- Practical experience building and
maintaining data pipelines using tools like Apache Airflow or DBT.
- Hands-on experience with cloud
platforms (AWS, GCP, Azure) and data warehousing solutions (Redshift, BigQuery,
Snowflake).
- Familiarity with big data technologies
and frameworks, including Spark, Kafka, and Hadoop.
- Demonstrated ability to solve complex
problems with a strong focus on detail.
- Experience implementing CI/CD practices
for data workflows.
- Working knowledge of data modelling
principles and schema design.
- Exposure to machine learning pipelines
or real-time analytics systems is a plus
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Owns the architecture, engineering standards, and technology roadmap for a secure healthcare data platform across AWS, Azure, and Databricks. Designs ingestion, lakehouse, interoperability, governance, privacy, analytics, and operational reporting solutions. Establishes standards for Spark, Python, SQL, data quality, observability, metadata, CI/CD, infrastructure as code, and disaster recovery. Leads healthcare data interoperability, security architecture, proofs of concept, performance assessments, technical roadmaps, and executive decision support.
Top Skills:
Amazon EventbridgeAmazon S3Apache IcebergSparkAthenaAuto LoaderAWSAws LambdaAws Secrets ManagerAws Step FunctionsAzureCi/CdClinical NlpCloudwatchCptDatabricksDatabricks SqlDatabricks WorkflowsDelta LakeEcsEksFhir R4Hl7 V2Icd-10Infrastructure As CodeJSONKmsLlmsLoincMlopsNdjsonOmop CdmPysparkPythonRxnormSnomed CtSnowflakeSQLSreTrinoUnity CatalogXML
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Analyze business and user requirements across financial services value streams, define technical requirements, develop cloud solution options, and manage business and IT stakeholders. The role requires understanding existing framework capabilities, complex data models, cross-functional solution design, clear documentation, team coordination across regions, and familiarity with the SDLC from design through testing and implementation.
Top Skills:
Google Cloud Platform
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Provide L1-L3 production support for enterprise MongoDB Atlas environments, including monitoring, scaling, backups, upgrades, performance tuning, security, networking, disaster recovery, and incident resolution. Build Terraform-based infrastructure automation, support multi-cloud deployments across Azure, AWS, and GCP, partner with application and engineering teams, coordinate vendor escalations, and participate in 24/7 on-call coverage.
Top Skills:
AWSAzureGCPGitGithub ActionsGoJavaKubernetesMongodb AtlasPowershellPythonShellSQL ServerTerraform
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
