Yubi Logo

Yubi

Senior Data Engineer

Posted 19 Hours Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Designs, builds, maintains, and optimizes scalable data pipelines using Python and PySpark. Integrates multiple data sources, orchestrates workflows with Airflow or Temporal, troubleshoots failures, performs root cause analysis, and supports evolving business requirements. Collaborates with stakeholders across on-premise and cloud environments, including client-site deployments and support. Requires flexible working hours, weekend or shift support, and travel to client locations.
The summary above was generated by AI

About Yubi


Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the discovery, investment, fulfillment, and collection of any debt solution. At Yubi, opportunities are plenty and we equip you with tools to seize it.

In March 2022, we became India's fastest fintech and most impactful startup to join the unicorn club with a Series B fundraising round of $137 million.

In 2020, we began our journey with a vision of transforming and deepening the global institutional debt market through technology. Our two-sided debt marketplace helps institutional and HNI investors find the widest network of corporate borrowers and debt products on one side and helps corporates to discover investors and access debt capital efficiently on the other side. Switching between platforms is easy, which means investors can lend, invest and trade bonds - all in one place. Our platforms shake up the traditional debt ecosystem and offer new ways of digital finance.
Spocto - Debt recovery & risk mitigation platform
So far, we have onboarded more than 17000 enterprises, 6200 investors, and lenders and facilitated debt volumes of over INR 1,40,000 crore.

Backed by marquee investors like Insight Partners, B Capital Group, Dragoneer, Sequoia Capital, LightSpeed and Lightrock, we are the only-of-its-kind debt platform globally, revolutionizing the segment.

At Yubi, People are at the core of the business and our most valuable assets. Yubi is constantly growing, with 1000+ like-minded individuals today who are changing the way people perceive debt. We are a fun bunch who are highly motivated and driven to create a purposeful impact. Come join the club to be a part of our epic growth story.


About the Role
As a Senior Data Engineer, you will design, build, and maintain efficient data pipelines that drive our data-driven decision-making. You'll ensure seamless data integration and processing from multiple sources, while optimising performance and reliability. Collaboration with cross-functional teams will be key to meeting business needs in both on-premise and cloud environments.
Role and Responsibilities-
  • Utilise PySpark and Python to build scalable data pipelines.

  • Integrate data from multiple source systems into a unified target.

  • Orchestrate and schedule pipelines using Airflow or Temporal for reliable execution.

  • Enhance existing pipelines to meet evolving business requirements.

  • Optimise pipelines for performance and cost.

  • Troubleshoot and resolve pipeline failures quickly.

  • Conduct root cause analysis and implement corrective measures.

  • Collaborate with stakeholders to address data processing needs.

  • Provide support on weekends and shifts as required.

  • Travel to client locations for on-prem pipeline development, deployment and support.

Experience & Expertise

  • Minimum 5 years of experience as a Data Engineer.

  • Proficient in SQL, Python, and PySpark.

  • Strong knowledge of data warehousing techniques and dimensional modelling.

  • Experience with Airflow or Temporal for complex workflow orchestration.

  • Familiarity with Docker and version control systems.

  • Expertise in data modelling and DBT (Data Build Tool).

  • Knowledge of AWS infrastructure is a plus.

  • Ability to adapt to flexible working hours to support business needs.




HQ

Yubi Chennai, Tamil Nadu, IND Office

Chennai, Tamil Nadu, India, 600035

Similar Jobs

19 Hours Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Fintech • Analytics • Financial Services
Build, orchestrate, enhance, and troubleshoot scalable data pipelines using Python, PySpark, SQL, and Apache Airflow. Integrate multiple data sources, optimize pipeline performance, conduct root cause analysis, and apply data modeling and warehousing techniques. Collaborate with stakeholders to meet data-processing needs and provide weekend or shift support when required.
Top Skills: Apache AirflowAWSDbtDockerPysparkPythonSQL
2 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Software
Design and implement scalable Snowflake data architectures, optimize platform performance, develop data processing workflows with Snowpark, Python, and PySpark, and lead Hadoop-to-Snowflake migrations. The role defines target-state data warehouse architectures, establishes design standards, improves query and warehouse efficiency, ensures data integrity, and provides architectural guidance for enterprise cloud data modernization initiatives.
Top Skills: HadoopPysparkPythonSnowflakeSnowpark
9 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Cloud • Information Technology • Consulting • Cybersecurity
Design, build, and maintain scalable ETL/ELT data pipelines and data warehouse solutions using Snowflake. Optimize data models and query performance, ensure data quality, integrate multiple sources, implement security and governance, and collaborate with BI and product teams to deliver reliable datasets.
Top Skills: AirflowAWSAzureCi/CdDbtDevOpsGCPHadoopInformaticaKafkaKinesisPythonScalaSnowflakeSparkSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account