Yubi Logo

Yubi

Senior Data Engineer

Posted 21 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Build, orchestrate, enhance, and troubleshoot scalable data pipelines using Python, PySpark, SQL, and Apache Airflow. Integrate multiple data sources, optimize pipeline performance, conduct root cause analysis, and apply data modeling and warehousing techniques. Collaborate with stakeholders to meet data-processing needs and provide weekend or shift support when required.
The summary above was generated by AI

About YUBI 


Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the discovery, investment, fulfilment, and collection of any debt solution. At Yubi, opportunities are plenty and we equip you with tools to seize it.

In March 2022,  we became India’s fastest fintech and most impactful startup to join the unicorn club with a Series B fundraising round of $137 million.

In 2020, we began our journey  with a vision of transforming and deepening the global institutional debt market through technology. Our two-sided debt marketplace helps institutional and HNI investors find the widest network of corporate borrowers and debt products on one side and helps corporates to discover investors and access debt capital efficiently on the other side. Switching between platforms is easy, which means investors can lend, invest and trade bonds - all in one place. All 5 of our platforms shake up the traditional debt ecosystem and offer new ways of digital finance.

 

  • Yubi Loans – Term loans and working capital solutions for enterprises.

  • Yubi Invest – Bond issuance and investments for institutional and retail participants.

  • Yubi Pool– End-to-end securitisations and portfolio buyouts.

  • Yubi Flow – A supply chain platform that offers trade financing solutions.

  • Yubi Co.Lend – For banks and NBFCs for co-lending partnerships.

 

Currently, we have boarded over 4000+ corporates, 350+ investors and have facilitated debt volumes of over INR 40,000 crore.

Backed by marquee investors like Insight Partners, B Capital Group, Dragoneer, Sequoia Capital, LightSpeed and Lightrock, we are the only-of-its-kind debt platform globally, revolutionizing the segment.

 

At Yubi, People are at the core of the business and our most valuable assets. Yubi is constantly growing, with 650+ like-minded individuals today, who are changing the way people perceive debt. We are a fun bunch who are highly motivated and driven to create a purposeful impact. Come, join the club to be a part of our epic growth story.


About the Role

This role requires a well-rounded data engineer with hands-on experience in data processing technologies, a good understanding of data modeling concepts, and the ability to collaborate effectively with various stakeholders. The willingness to adapt to flexible working hours demonstrates a commitment to supporting the continuous operation of data pipelines and meeting business needs.


 

Responsibilities:

  1. Build Data Pipelines:

    • Utilize PySpark and Python to construct efficient and scalable data pipelines.

    • Integrate data from multiple source systems into a unified target system.

  2. Orchestrate Pipelines with Airflow:

    • Use Apache Airflow to orchestrate and schedule data pipelines, ensuring timely and reliable execution.

  3. Enhance Existing Pipelines:

    • Understand existing data pipelines and make enhancements based on evolving business requirements.

    • Implement improvements to optimize performance and maintainability.

  4. Debugging and Root Cause Analysis:

    • Troubleshoot and resolve any failures in data pipelines promptly.

    • Conduct root cause analysis for pipeline failures and implement corrective measures.

  5. Collaboration with Stakeholders:

    • Work closely with various stakeholders, both within and across teams.

    • Communicate effectively to understand and address business needs related to data processing.

  6. Weekend and Shift Support:

    • Be available to work on weekends and in shifts if necessary to provide support for business operations.



Requirements
  1. Experience:

    • 3-5 years of experience as a data engineer, demonstrating a solid understanding of data engineering principles.

  2. Technical Skills:

    • Proficient in SQL, Python, and PySpark for designing and implementing data solutions.

    • Knowledge of data warehousing techniques and dimensional modeling.

  3. Orchestration Tools:

    • Experience with Apache Airflow for orchestrating complex data workflows.

    • Familiarity with containerization using Docker and version control systems.

  4. Data Modelling and Transformation:

    • Exhibit strong proficiency in data modeling techniques, emphasizing expertise in designing and implementing effective data structures.

    • Knowledge of DBT (Data Build Tool) for transforming and modeling data.

  5. Cloud Platform:

    • AWS knowledge is a plus, showcasing familiarity with cloud-based data services and infrastructure.



HQ

Yubi Chennai, Tamil Nadu, IND Office

Chennai, Tamil Nadu, India, 600035

Similar Jobs

2 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Consulting
Designs, builds, and optimizes scalable data pipelines, ETL/ELT processes, integrations, and cloud data platforms. Ensures data quality, governance, observability, reliability, and efficient processing for analytics and AI/ML initiatives. Supports Meridian platform implementation, troubleshoots production issues, automates workflows, and collaborates with architects, analysts, product owners, and stakeholders. Provides technical mentorship, participates in architecture and code reviews, and promotes engineering best practices.
Top Skills: Apache AirflowAutomated TestingAWSAzureAzure Data FactoryAzure Event HubsAzure SynapseCi/CdData LakesData WarehousingDatabricksDevOpsEtl/EltGCPInfrastructure As CodeJavaKafkaMicrosoft FabricPythonScalaSnowflakeSpark StreamingSQL
5 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Fintech • Financial Services
Design, develop, and maintain scalable ETL and ELT pipelines, data architectures, data lakes, warehouses, and lakehouse solutions. Implement data quality, validation, monitoring, and lineage frameworks. Build and optimize cloud data solutions using Spark, Kafka, and Databricks, while tuning SQL queries and pipeline workflows for performance and cost efficiency.
Top Skills: Apache KafkaSparkData LakesData WarehousesDatabricksEltETLHadoopLakehouseNoSQLPythonRelational DatabasesSQL
6 Days Ago
In-Office
Senior level
Senior level
eCommerce • Information Technology • Marketing Tech • Design
Designs and owns scalable Azure-based data platforms, including enterprise data warehouses, ETL/ELT pipelines, PySpark and Delta Lake transformations, dimensional models, and Power BI analytics. The role also covers data quality, reconciliation, financial reporting logic, API ingestion, performance optimization, CI/CD, stakeholder collaboration, architecture best practices, and mentoring junior engineers.
Top Skills: Apache AirflowSparkAzure Data FactoryAzure Data LakeAzure DatabricksAzure SqlDaxDelta LakeDynamics 365 Finance And OperationsDynamoDBGitGithub ActionsInformatica PowercenterAzureMicrosoft Dynamics AxMicrosoft FabricMongoDBNumpyPandasPl/SqlPostgresPower BIPower QueryPysparkPythonRest ApisSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account