Migrate and implement Cybermation jobs into Apache Airflow by analyzing existing schedules and scripts, designing and developing DAGs, configuring schedules, retries, logging and alerting, performing dry runs and validation, producing migration and runbook documentation, and coordinating deployments and hypercare with client teams.
- Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.
- Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.
- Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.
- Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.
- Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.
- Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.
- Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.
- Analyze existing Cybermation job schedules, dependency patterns, runtime parameters, execution frequency, owners, success/failure behavior, and operational support expectations.
- Review existing shell scripts and API/cURL invocation logic to determine the appropriate Airflow DAG design, task structure, error handling, and retry configuration.
- Design, develop, and maintain Apache Airflow DAGs to orchestrate shell scripts, API calls, and dependent jobs with appropriate scheduling and operational controls.
- Configure Airflow schedules, task dependencies, retries, logging, alerting hooks, variables, connections, parameters, and environment-specific configuration as per client standards.
- Perform dry runs, unit testing, schedule validation, API response validation, failure/retry validation, and production-readiness checks for migrated jobs.
- Create migration mapping, validation evidence, deployment notes, operational runbooks, and support handover documentation.
- Coordinate with client SMEs, application owners, infrastructure teams, and release teams to support deployment, issue triage, initial run monitoring, and hypercare.
- Bachelor’s degree or equivalent experience in Computer Science, Information Technology, Engineering, or a related discipline.
- 4+ years of overall engineering experience with hands-on Airflow, Python, and Linux/shell exposure.
- Strong practical understanding of job scheduling, batch/workflow orchestration, production readiness, and operational support processes.
EXL Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Fintech • Financial Services
Design, develop, and deploy scalable data-processing solutions on AWS using Java and Apache Spark. Build Spark pipelines on EMR, serverless applications with AWS Lambda, containerized microservices on Amazon EKS, and complex workflow orchestration with Apache Airflow.
Top Skills:
Amazon EksApache AirflowSparkAWSAws EmrAws LambdaJavaKubernetesMicroservices
Digital Media • Information Technology • News + Entertainment
Designs and customizes software applications, manages releases, gathers requirements, and improves functionality and user experience. Collaborates with stakeholders, QA, and cross-functional teams to deliver reliable solutions. Tracks performance metrics, maintains technical documentation, researches industry trends, and leads development, prototyping, and design sessions. Mentors junior engineers and exercises independent judgment while supporting variable work schedules.
Digital Media • Information Technology • News + Entertainment
Develops and optimizes data structures, ingestion frameworks, ETL pipelines, warehouses, and data lakes. Ensures data quality, governance, lineage, and compliance while supporting analytics and machine learning initiatives. Designs storage solutions across on-premises and cloud platforms, manages migrations, develops APIs, monitors data flows, collaborates with technology and analytics teams, and participates in code reviews and model deployments.
Top Skills:
Amazon RedshiftAPIsAws S3DatabricksETLKubernetesMinioTeradata
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
