Lead Data Engineer

About YUBI

Yubi, formerly known as CredAvenue, is re-defining global debt markets by freeing the flow of finance between borrowers, lenders, and investors. We are the world's possibility platform for the discovery, investment, fulfilment, and collection of any debt solution. At Yubi, opportunities are plenty and we equip you with tools to seize it.

In March 2022, we became India’s fastest fintech and most impactful startup to join the unicorn club with a Series B fundraising round of $137 million.

In 2020, we began our journey with a vision of transforming and deepening the global institutional debt market through technology. Our two-sided debt marketplace helps institutional and HNI investors find the widest network of corporate borrowers and debt products on one side and helps corporates to discover investors and access debt capital efficiently on the other side. Switching between platforms is easy, which means investors can lend, invest and trade bonds - all in one place. All 5 of our platforms shake up the traditional debt ecosystem and offer new ways of digital finance.

• Yubi Loans – Term loans and working capital solutions for enterprises.
• Yubi Invest – Bond issuance and investments for institutional and retail participants.
• Yubi Pool– End-to-end securitisations and portfolio buyouts.
• Yubi Flow – A supply chain platform that offers trade financing solutions.
• Yubi Co.Lend – For banks and NBFCs for co-lending partnerships.
  
  

Currently, we have boarded over 4000+ corporates, 350+ investors and have facilitated debt volumes of over INR 40,000 crore.

Backed by marquee investors like Insight Partners, B Capital Group, Dragoneer, Sequoia Capital, LightSpeed and Lightrock, we are the only-of-its-kind debt platform globally, revolutionizing the segment.

At Yubi, People are at the core of the business and our most valuable assets. Yubi is constantly growing, with 650+ like-minded individuals today, who are changing the way people perceive debt. We are a fun bunch who are highly motivated and driven to create a purposeful impact. Come, join the club to be a part of our epic growth story.

About The Role

We are looking for a highly skilled Lead Data Engineer to design, develop, and optimize our data infrastructure while driving business and stakeholder engagement. The ideal candidate will have strong experience in system design, data modelling and warehouse design, Python, SQL, Apache Spark, and real-time streaming technologies. They will play a crucial role in defining data strategies, building scalable pipelines, and data modelling for OLTP & OLAP systems.

Key Responsibilities

Data Engineering & System Design

• Architect, build, and optimize scalable, high-performance data pipelines for batch and real-time processing.
• Design and maintain data lakes, warehouses, and lakehouses to support business intelligence and analytics.
• Implement best practices in data modeling, governance, and security.
• Work with distributed computing frameworks (Apache Spark, Kafka, Flink) to ensure efficient data processing.
• Improve query performance and cost optimization in cloud-based environments (AWS, GCP, Azure).
  
  

Stakeholder & Business Management

• Collaborate with business leaders, product managers, and analysts to understand data needs and translate them into engineering solutions.
• Drive data strategy and roadmap, aligning engineering initiatives with business goals.
• Communicate technical concepts to non-technical stakeholders, influencing decision-making.
• Ensure data quality, availability, and compliance with regulatory and business requirements.
  
  

Technical Leadership & Mentorship

• Lead and mentor a team of data engineers, fostering a culture of innovation and excellence.
• Define best practices for data engineering, including coding standards, documentation, and automation.
• Drive adoption of emerging technologies and tools to improve data infrastructure.
• Conduct code reviews, performance tuning, and optimization for existing pipelines.
  
  

Requirements

Required Skills & Experience

• 8+ years of experience in data engineering, system design, and large-scale data processing.
• Strong programming skills in Python and SQL for data transformation and analysis.
• Expertise in Apache Spark (PySpark/Scala), Kafka, Flink, or similar real-time data processing frameworks.
• Hands-on experience with cloud-based data platforms (AWS, GCP, Azure) and tools like Redshift, Athena, Snowflake, BigQuery.
• Hands-on experience in data ecosystem like dbt, Airflow
• Proficiency in data modeling, ETL processes, and performance optimization.
• Experience with data governance, security, and compliance standards.
• Strong business acumen with the ability to drive data-driven decisions.
• Excellent communication, stakeholder management, and leadership skills.
  
  

Nice to Have

• Experience with Gen AI
• Knowledge of CI/CD pipelines and DevOps practices for data engineering.