Med-Metrix Logo

Med-Metrix

Senior Data Engineer

Reposted Yesterday
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Designs, builds, and maintains scalable data pipelines and architectures supporting Denials AI workflows. Responsibilities include developing ETL/ELT pipelines, modeling PostgreSQL data, optimizing SQL, monitoring pipeline performance, troubleshooting incidents, enforcing data quality and HIPAA compliance, automating deployments, documenting workflows, conducting code reviews, and mentoring junior engineers.
The summary above was generated by AI

Job Purpose

The Senior Data Engineer designs, builds, and maintains scalable data pipelines and architectures to support the Denials AI workflow under the guidance of the Team Lead, Data Management. This role ensures data is reliable, compliant with HIPAA, and optimized.

 

Required Hours: 9AM-5PM EST

 

Duties & Responsibilities

 

  • Collaborate with the Team Lead and cross‑functional teams to gather and refine data requirements for Denials AI solutions
  • Design, implement, and optimize ETL/ELT pipelines using Python, Dagster, DBT, and AWS data services (Athena, Glue, SQS)
  • Develop and maintain data models in PostgreSQL; write efficient SQL for querying and performance tuning
  • Monitor pipeline health and performance; troubleshoot data incidents and implement preventive measures
  • Enforce data quality and governance standards, including HIPAA compliance for PHI handling
  • Conduct code reviews, share best practices, and mentor junior data engineers
  • Automate deployment and monitoring tasks using infrastructure-as-code and AWS CloudWatch metrics and alarms
  • Document data workflows, schemas, and operational runbooks to support team knowledge transfer
  • Other duties as assigned
  • Use, protect and disclose patients’ protected health information (PHI) only in accordance with Health Insurance Portability and Accountability Act (HIPAA) standards
  • Understand and comply with Information Security and HIPAA policies and procedures at all times
  • Limit viewing of PHI to the absolute minimum as necessary to perform assigned duties

 

Qualifications

 

  • Bachelor’s or master’s degree in Computer Science, Data Engineering, or related field
  • 5+ years of hands‑on experience building and operating production‑grade data pipelines
  • Solid experience with workflow orchestration tools (Dagster) and transformation frameworks (DBT) or other similar tools such (Microsoft SSIS, AWS Glue, Air Flow)
  • Strong SQL skills on PostgreSQL for data modeling and query optimization or any other similar technologies (Microsoft SQL Server, Oracle, AWS RDS)
  • Working knowledge with AWS data services: Athena, Glue, SQS, SNS, IAM, and CloudWatch
  • Basic proficiency in Python and Python data frameworks (Pandas, PySpark)
  • Experience with version control (GitHub) and CI/CD for data projects
  • Familiarity with healthcare data standards and HIPAA compliance
  • Experience mentoring or leading small technical efforts
  • Proficiency in Microsoft Office Suite
  • Strong interpersonal skills, ability to communicate well at all levels of the organization
  • Strong problem solving and creative skills and the ability to exercise sound judgment and make decisions based on accurate and timely analyses
  • High level of integrity and dependability with a strong sense of urgency and results oriented 
  • Excellent written and verbal communication skills required

 

Working Conditions

  • Regular working hours; on-call for data pipeline incident response.
  • Must possess a smart-phone or electronic device capable of downloading applications, for multifactor authentication and security purposes. 
  • Physical Demands: While performing the duties of this job, the employee is occasionally required to move around the work area; Sit; perform manual tasks; operate tools and other office equipment such as computer, computer peripherals and telephones; extend arms; kneel; talk and hear.
  • Mental Demands: The employee must be able to follow directions, collaborate with others, and handle stress.
  • Work Environment: The noise level in the work environment is usually minimal.

 

Med-Metrix will not discriminate against any employee or applicant for employment because of race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), parental status, national origin, age, disability, genetic information (including family medical history), political affiliation, military service, veteran status, other non-merit based factors, or any other characteristic protected by federal, state or local law.

Similar Jobs

6 Days Ago
Hybrid
Senior level
Senior level
Blockchain • Database • Analytics
Build and maintain scalable Databricks ETL/ELT pipelines using Python, PySpark, and SQL. Integrate databases, files, Amazon S3, and REST APIs; manage Delta Lake tables and Unity Catalog; develop dimensional models; schedule and optimize workflows; ensure data quality; tune Spark workloads; and collaborate on production-ready solutions.
Top Skills: Amazon S3Apache AirflowApache KafkaAWSCi/CdDatabricksDbtDelta LakeGitPysparkPythonRest ApisSparkSQLUnity Catalog
Yesterday
In-Office or Remote
Chennai, Tamil Nadu, IND
Senior level
Senior level
Healthtech
Build and maintain scalable ETL/ELT pipelines and data architectures for Denials AI workflows. Develop PostgreSQL data models, optimize SQL, monitor pipeline health, troubleshoot incidents, enforce data quality and HIPAA compliance, and automate deployments using AWS services and infrastructure-as-code. The role also includes code reviews, mentoring junior engineers, documentation, cross-functional requirements gathering, and on-call incident response.
Top Skills: Amazon AthenaAmazon CloudwatchAmazon SnsAmazon SqsAWSAws GlueAws IamCi/CdDagsterDbtGitMicrosoft Office SuitePandasPostgresPysparkPythonSQL
24 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Automotive
Designs and operates scalable batch and streaming data pipelines, ETL/ELT frameworks, data models, APIs, and cloud-native services supporting ADAS and autonomous-driving solutions. Ensures data quality, security, governance, observability, and reliability across AWS or Azure platforms. Partners with AI/ML and MLOps teams to deliver production-ready datasets and features, while contributing to architecture, CI/CD, infrastructure automation, technical standards, and mentoring.
Top Skills: Amazon KinesisApache AirflowApache IcebergApache KafkaSparkAWSAws Step FunctionsAzureAzure Data FactoryAzure Event HubsCi/CdCloudFormationDatabricksDbtDelta LakeDockerElkEltETLGitGrafanaKibanaKubernetesMlopsNoSQLOpensearchPower BIPythonQlik SenseRest ApisSQLTerraform

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account