Convo Logo

Convo

Senior Python Data Engineer

Posted 2 Days Ago
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in Islāmābād, Firozpur, Punjab, IND
Senior level
Remote or Hybrid
Hiring Remotely in Islāmābād, Firozpur, Punjab, IND
Senior level
Maintain and enhance production Python and SQL data pipelines using Airflow, Azure Data Factory, and Spark. Implement schema, completeness, freshness, reconciliation, monitoring, logging, and alerting controls. Troubleshoot pipeline failures, data-quality incidents, and performance regressions; support incremental processing and operational stability. Document root causes, fixes, preventive actions, runbooks, and handover procedures while collaborating with data engineering and platform operations teams.
The summary above was generated by AI
Job Summary:

Convo is looking for Python Data Engineers with 3+ years of experience in production data engineering and pipeline operations. The ideal candidate should have strong expertise in Python, SQL, Airflow/Azure Data Factory, Spark, data quality, schema validation, and monitoring, with the ability to troubleshoot pipeline issues, maintain reliable data workflows, and ensure data quality, freshness, and operational stability.

Technical mission

Maintain data pipelines, implement schema-validation automation and resolve operational incidents within the approved platform architecture.

Key responsibilities
  • Maintain and enhance Python/SQL pipelines orchestrated through Airflow, Azure Data Factory or equivalent.

  • Implement schema, completeness, freshness and reconciliation checks.

  • Diagnose and resolve pipeline failures, data-quality incidents and performance regressions.

  • Support Spark jobs and incremental data-processing patterns.

  • Add monitoring, structured logging and actionable alerts.

  • Document fixes, recurring failure patterns and operational procedures.

Required technical capabilities
  • Minimum experience: 3+ years in production data engineering or data-pipeline operations using Python and SQL.

  • Production Python and SQL for data engineering.

  • Airflow, Azure Data Factory or comparable workflow orchestration.

  • Working knowledge of Spark and distributed data-processing concepts.

  • Data-quality and schema-validation implementation.

  • Monitoring, incident triage and root-cause analysis.

  • Version control, automated testing and controlled deployment practices.

Preferred experience
  • Databricks, Delta Lake and cloud storage patterns.

  • On-call or production-support experience for data platforms.

  • CPG, retail or enterprise-source data.

Expected deliverables / acceptance evidence
  • Stable pipelines meeting agreed freshness and quality thresholds.

  • Automated validation and monitoring coverage.

  • Closed incidents with documented root cause and preventive action.

  • Updated runbooks and maintainable handover documentation.

Primary interfaces

Works with Senior Data Engineers, Telemetry Support, connector teams and platform operations.

What We Have For You
  • Great compensation package, medical benefit for you and your family, free lunch, annual performance-tied increments & performance recognition awards and a great lean and agile work culture!
  • Convo endorses a culture of diversity in all aspects and aims to build a diverse team of amazing individuals!

Similar Jobs

18 Days Ago
In-Office or Remote
2 Locations
Senior level
Senior level
Agency • Information Technology
Design and implement data federation and lakehouse architectures (Starburst/Trino), build scalable ETL/ELT pipelines using Python and Spark, optimize Spark and federated queries, manage Delta/Iceberg/Hudi tables, and enforce governance, access control, and data masking for analytics and AI use.
Top Skills: AdlsApache IcebergSparkAws EmrAzure DatabricksDbtDelta LakeDremioGCPGlueHudiKubernetesMedallion ArchitecturePrestoPulumiPysparkPythonS3Snowflake SchemaSQLStar SchemaStarburst EnterpriseTerraformTrino
Yesterday
Easy Apply
Remote or Hybrid
India
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage enterprise customer accounts as a trusted technical advisor, driving platform adoption, measurable business value, and technical ROI. Develop success plans, troubleshoot complex hardware, software, and API issues, manage escalations, conduct root-cause analysis, and lead technical reviews. Collaborate with Sales, Support, Product, and Engineering while communicating effectively with technical and executive stakeholders. Use AI tools to improve customer insights and outcomes, and contribute to knowledge sharing and team development.
Top Skills: AIAPIsGainsightGongInternet Of Things (Iot)JIRAPaasPythonSaaSSalesforceTableauZendesk
Yesterday
Remote or Hybrid
India
Entry level
Entry level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Tests liquidity risk and regulatory reporting releases across PRA, EBA, HKMA, and US Federal Reserve requirements. Responsibilities include SQL-based data validation, test strategy and execution, defect management, UAT dashboards, requirements gathering, data-gap analysis, issue resolution, and stakeholder communication. The role also supports finance data quality initiatives, regulatory compliance, operating-model transitions, change implementation, and coordination across Finance, Risk, Business, and IT teams.
Top Skills: ExcelMicrosoft PowerpointMicrosoft ProjectMicrosoft VisioMicrosoft WordQuality CentreSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account