EXL Logo

EXL

Airflow Engineer

Posted 17 Days Ago
Be an Early Applicant
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Migrate and implement Cybermation jobs into Apache Airflow by analyzing existing schedules and scripts, designing and developing DAGs, configuring schedules, retries, logging and alerting, performing dry runs and validation, producing migration and runbook documentation, and coordinating deployments and hypercare with client teams.
The summary above was generated by AI
  • Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.
  • Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.
  • Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.
  • Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.
  • Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.
  • Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.
  • Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.
Responsibilities
  • Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.
  • Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.
  • Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.
  • Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.
  • Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.
  • Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.
  • Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.
Qualifications
  • Bachelor’s degree or equivalent experience in Computer Science, Information Technology, Engineering, or a related discipline.
  • 4+ years of overall engineering experience with hands-on Airflow, Python, and Linux/shell exposure.
  • Strong practical understanding of job scheduling, batch/workflow orchestration, production readiness, and operational support processes.

EXL Chennai, Tamil Nadu, IND Office

Chennai, India

Similar Jobs

20 Minutes Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Lead Oracle Cloud HCM integration architecture for global HR technology. Partner with business and technical stakeholders to gather and model requirements, guide development teams, create solution documentation and user stories, facilitate adoption, and support the full SDLC. Deliver technical solutions across Hire to Retire, Benefits, and Core HR while solving complex business problems, analyzing data, and supporting Agile process improvements.
Top Skills: Hcm ExtractHdlExcelOracle Ai StudioOracle Cloud HcmOracle Integration Cloud (Oic)Oracle Visual Builder Cloud Service (Vbcs)
42 Minutes Ago
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Digital Media • Information Technology • News + Entertainment
Build, maintain, and improve an automation platform, including workflows, CI/CD pipelines, and Go- or Python-based tools. Collaborate with stakeholders to identify automation opportunities, support Kubernetes and cloud-based applications, and contribute to platform reliability through rotating on-call coverage. The role requires independent execution, strong communication, and knowledge of Terraform, AWS, Jenkins, and ArgoCD.
Top Skills: ArgocdAWSCi/CdGoJenkinsKubernetesPythonTerraform
43 Minutes Ago
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Digital Media • Information Technology • News + Entertainment
Edits and enhances video and audio content by assembling footage, selecting takes, refining sequences, correcting frame-length issues, and conforming assets to technical specifications. Collaborates with clients, agencies, and internal teams to deliver samples and final edits. Uses Adobe tools and proprietary systems, applies independent editorial judgment, and works India night-shift hours, including nights and weekends.
Top Skills: Adobe After EffectsMp4MpegZendesk

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account