Yubi Logo

Yubi

Senior Data Engineer

Posted One Month Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Build, orchestrate, enhance, and troubleshoot scalable data pipelines using Python, PySpark, SQL, and Apache Airflow. Integrate multiple data sources, optimize pipeline performance, conduct root cause analysis, and apply data modeling and warehousing techniques. Collaborate with stakeholders to meet data-processing needs and provide weekend or shift support when required.
The summary above was generated by AI

About YUBI 


Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the discovery, investment, fulfilment, and collection of any debt solution. At Yubi, opportunities are plenty and we equip you with tools to seize it.

In March 2022,  we became India’s fastest fintech and most impactful startup to join the unicorn club with a Series B fundraising round of $137 million.

In 2020, we began our journey  with a vision of transforming and deepening the global institutional debt market through technology. Our two-sided debt marketplace helps institutional and HNI investors find the widest network of corporate borrowers and debt products on one side and helps corporates to discover investors and access debt capital efficiently on the other side. Switching between platforms is easy, which means investors can lend, invest and trade bonds - all in one place. All 5 of our platforms shake up the traditional debt ecosystem and offer new ways of digital finance.

 

  • Yubi Loans – Term loans and working capital solutions for enterprises.

  • Yubi Invest – Bond issuance and investments for institutional and retail participants.

  • Yubi Pool– End-to-end securitisations and portfolio buyouts.

  • Yubi Flow – A supply chain platform that offers trade financing solutions.

  • Yubi Co.Lend – For banks and NBFCs for co-lending partnerships.

 

Currently, we have boarded over 4000+ corporates, 350+ investors and have facilitated debt volumes of over INR 40,000 crore.

Backed by marquee investors like Insight Partners, B Capital Group, Dragoneer, Sequoia Capital, LightSpeed and Lightrock, we are the only-of-its-kind debt platform globally, revolutionizing the segment.

 

At Yubi, People are at the core of the business and our most valuable assets. Yubi is constantly growing, with 650+ like-minded individuals today, who are changing the way people perceive debt. We are a fun bunch who are highly motivated and driven to create a purposeful impact. Come, join the club to be a part of our epic growth story.


About the Role

This role requires a well-rounded data engineer with hands-on experience in data processing technologies, a good understanding of data modeling concepts, and the ability to collaborate effectively with various stakeholders. The willingness to adapt to flexible working hours demonstrates a commitment to supporting the continuous operation of data pipelines and meeting business needs.


 

Responsibilities:

  1. Build Data Pipelines:

    • Utilize PySpark and Python to construct efficient and scalable data pipelines.

    • Integrate data from multiple source systems into a unified target system.

  2. Orchestrate Pipelines with Airflow:

    • Use Apache Airflow to orchestrate and schedule data pipelines, ensuring timely and reliable execution.

  3. Enhance Existing Pipelines:

    • Understand existing data pipelines and make enhancements based on evolving business requirements.

    • Implement improvements to optimize performance and maintainability.

  4. Debugging and Root Cause Analysis:

    • Troubleshoot and resolve any failures in data pipelines promptly.

    • Conduct root cause analysis for pipeline failures and implement corrective measures.

  5. Collaboration with Stakeholders:

    • Work closely with various stakeholders, both within and across teams.

    • Communicate effectively to understand and address business needs related to data processing.

  6. Weekend and Shift Support:

    • Be available to work on weekends and in shifts if necessary to provide support for business operations.



Requirements
  1. Experience:

    • 3-5 years of experience as a data engineer, demonstrating a solid understanding of data engineering principles.

  2. Technical Skills:

    • Proficient in SQL, Python, and PySpark for designing and implementing data solutions.

    • Knowledge of data warehousing techniques and dimensional modeling.

  3. Orchestration Tools:

    • Experience with Apache Airflow for orchestrating complex data workflows.

    • Familiarity with containerization using Docker and version control systems.

  4. Data Modelling and Transformation:

    • Exhibit strong proficiency in data modeling techniques, emphasizing expertise in designing and implementing effective data structures.

    • Knowledge of DBT (Data Build Tool) for transforming and modeling data.

  5. Cloud Platform:

    • AWS knowledge is a plus, showcasing familiarity with cloud-based data services and infrastructure.



HQ

Yubi Chennai, Tamil Nadu, IND Office

Chennai, Tamil Nadu, India, 600035

Similar Jobs

5 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Information Technology • Marketing Tech • Analytics
Leads the architecture, development, and governance of enterprise-scale cloud data platforms on GCP. Designs data lakes, warehouses, marts, ETL/ELT frameworks, batch and event-driven pipelines, and analytics solutions. Provides technical leadership, mentoring, code and architecture reviews, and engineering standards. Ensures data quality, security, observability, monitoring, and governance while optimizing BigQuery performance and cloud costs. Collaborates with stakeholders to translate business requirements into scalable data products and supports production troubleshooting.
Top Skills: Apache AirflowArtificial IntelligenceBigQueryCloud ComposerCloud FunctionsCloud RunDatabricksDataflowDataprocEltETLGenerative AiGitGoogle Cloud Platform (Gcp)Google Cloud Storage (Gcs)Infrastructure As Code (Iac)Large Language Models (Llms)LookerMachine LearningPower BIPub/SubPythonQlik SenseSnowflakeSQLTektonTerraform
5 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Hardware • Other • Appliances
Leads investigation and resolution of complex data support issues involving pipelines, transformations, data quality, reporting, and integrations. Performs root cause analysis, defines preventive controls, improves monitoring and documentation, supports production deployments, and guides junior engineers. Collaborates with technical and business stakeholders to improve data reliability, governance, performance, and operational support practices.
Top Skills: APIsCloud Data PlatformsDashboardsData ModelingData PipelinesEnterprise Data WarehousesEtl/EltSQL
6 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Automotive
Designs and operates scalable batch and streaming data pipelines, ETL/ELT frameworks, data models, APIs, and cloud-native services supporting ADAS and autonomous-driving solutions. Ensures data quality, security, governance, observability, and reliability across AWS or Azure platforms. Partners with AI/ML and MLOps teams to deliver production-ready datasets and features, while contributing to architecture, CI/CD, infrastructure automation, technical standards, and mentoring.
Top Skills: Amazon KinesisApache AirflowApache IcebergApache KafkaSparkAWSAws Step FunctionsAzureAzure Data FactoryAzure Event HubsCi/CdCloudFormationDatabricksDbtDelta LakeDockerElkEltETLGitGrafanaKibanaKubernetesMlopsNoSQLOpensearchPower BIPythonQlik SenseRest ApisSQLTerraform

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account