Migrate and implement Cybermation jobs into Apache Airflow by analyzing existing schedules and scripts, designing and developing DAGs, configuring schedules, retries, logging and alerting, performing dry runs and validation, producing migration and runbook documentation, and coordinating deployments and hypercare with client teams.
- Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.
- Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.
- Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.
- Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.
- Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.
- Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.
- Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.
- Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.
- Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.
- Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.
- Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.
- Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.
- Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.
- Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.
- Bachelor’s degree or equivalent experience in Computer Science, Information Technology, Engineering, or a related discipline.
- 4+ years of overall engineering experience with hands-on Airflow, Python, and Linux/shell exposure.
- Strong practical understanding of job scheduling, batch/workflow orchestration, production readiness, and operational support processes.
EXL Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Provides senior technical leadership across data engineering, platform engineering, and application development initiatives. Responsibilities include architecture and design governance, engineering standards, modernization, cloud and AI adoption, production incident escalation, reliability improvement, and mentorship of engineers. The role drives technical strategy, system scalability, performance, security, operational stability, and delivery excellence across enterprise platforms.
Top Skills:
Ai/Ml PlatformsApache AirflowApache HiveSparkAWSCi/CdData LakesData WarehousingDatabricksDevOpsJavaKafkaObservability And Monitoring ToolsPysparkPythonSQL
Digital Media • Information Technology • News + Entertainment
Analyzes business and user needs, defines system requirements, prepares technical specifications, evaluates system impacts, and supports software solution integration. Maintains national code assignments and control tables, ensures data quality, collaborates with IT, vendors, testing teams, and business users, troubleshoots defects, supports audits, and extracts data using SQL queries.
Top Skills:
AIExcelMS OfficeMicrosoft PowerpointMicrosoft WordProcess AutomationSQL
Digital Media • Information Technology • News + Entertainment
Designs, develops, and integrates software solutions; analyzes requirements, customizes applications, supports releases and updates, troubleshoots technical issues, and partners with Quality Assurance. Mentors junior engineers, provides technical leadership, conducts application-user training, and uses market and industry research to inform project strategies. Requires independent judgment, reliable attendance, and flexibility for nights and weekends.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
