YipitData Logo

YipitData

Senior Data Pipeline Engineer

Posted 11 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
The Senior Data Pipeline Engineer will design, build, and maintain data pipelines while collaborating with analysts to optimize performance and support business needs. Responsibilities include performance bottleneck detection, code reviews, and documentation.
The summary above was generated by AI

About Us:

YipitData is the leading market research and analytics firm for the disruptive economy and most recently raised $475M from The Carlyle Group at a valuation of over $1B. Every day, our proprietary technology analyzes billions of alternative data points to uncover actionable insights across sectors like software, AI, cloud, e-commerce, ridesharing, and payments.

Our data and research teams transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customers—ranging from the world’s top investment funds to Fortune 500 companies—depend on to drive high-stakes decisions. From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence.

We operate globally with offices in the US (NYC, Austin, Miami, Mountain View), APAC (Hong Kong, Shanghai, Beijing, Guangzhou, Singapore), and India. Our award-winning, people-centric culture—recognized by Inc. as a Best Workplace for three consecutive years—emphasizes transparency, ownership, and continuous mastery.

What It’s Like to Work at YipitData:

YipitData isn’t a place for coasting—it’s a launchpad for ambitious, impact-driven professionals. From day one, you’ll take the lead on meaningful work, accelerate your growth, and gain exposure that shapes careers.

Why Top Talent Chooses YipitData:

  • Ownership That Matters: You’ll lead high-impact projects with real business outcomes
  • Rapid Growth: We compress years of learning into months
  • Merit Over Titles: Trust and responsibility are earned through execution, not tenure
  • Velocity with Purpose: We move fast, support each other, and aim high—always with purpose and intention

If your ambition is matched by your work ethic—and you're hungry for a place where growth, impact, and ownership are the norm—YipitData might be the opportunity you’ve been waiting for.

About The Role:

We are seeking a highly skilled Data Pipeline Engineer to join our dynamic Data Engineering team. The ideal candidate possesses 5 - 8 years of data engineering experience. An excellent candidate should have a solid understanding of Spark and SQL, and have data pipeline experience. Hired individuals will play a crucial role in helping to build out our data engineering team to support our strategic pipelines and optimize for reliability, efficiency, and performance.

Additionally, Data Engineering is the gold standard for YipitData analyst teams, building and maintaining the core pipelines and tooling that power our products. This high-impact, high-visibility team is instrumental to the success of our rapidly growing business. In this role, you’ll work closely with analysts, data engineers, and stakeholders to design, debug, and refine high-performance data pipelines in Databricks, while also helping to train and support internal users as the team’s responsibilities expand.

This is a remote opportunity based in India. 

During training and onboarding, we will expect several hours of overlap with US working hours.Afterward, standard IST working hours are permitted with the exception of 1-2 days per week, when you will join meetings with the US team.

As Our Data Pipeline Engineer You Will:

  • Report directly to the Senior Manager of Data Engineering, who will provide significant, hands-on training on cutting-edge data tools and techniques.
  • Design, build, and maintain reliable data pipelines that power key products and analyses.
  • Detect and resolve performance bottlenecks using Spark UI, logs, and metrics.
  • Contribute ideas to improve data models, coding standards, and ETL workflows across the team.
  • Collaborate with analysts and other engineers to convert business requirements into scalable datasets.
  • Participate in code reviews, author clear documentation, and share learnings through demos and write-ups.
  • Continuously deepen your expertise in Databricks, Spark, and AWS by owning increasingly complex projects.

You Are Likely To Succeed If:

  • You hold a Bachelor’s or Master’s degree in Computer Science, STEM, or a related technical discipline.
  • You have 5+ years of experience as a Data Engineer or in other technical functions.
  • You are excited about solving data challenges and learning new skills.
  • You have a great understanding of working with data or building data pipelines.
  • You are comfortable working with large-scale datasets using PySpark, Delta, and Databricks.
  • You understand business needs and the rationale behind data transformations to ensure alignment with organizational goals and data strategy.
  • You are eager to constantly learn new technologies.
  • You are a self-starter who enjoys working collaboratively with stakeholders.
  • You have exceptional verbal and written communication skills.

What We Offer:

Our compensation package includes comprehensive benefits, perks, and a competitive salary: 

  • We care about your personal life, and we mean it. We offer flexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more!
  • Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust. See more on our high-impact, high-opportunity work environment above!

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal-opportunity employer.

Job Applicant Privacy Notice


Top Skills

AWS
Databricks
Delta
Pyspark
Spark
SQL

Similar Jobs

Senior level
Big Data • eCommerce
Join YipitData as a Senior Data Pipeline Engineer, building and maintaining data pipelines, collaborating on solutions and optimizing data processes, with a focus on Spark and SQL.
Top Skills: AirflowDatabricksDbtDeltaPysparkSnowflakeSparkSQL
3 Minutes Ago
Remote or Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves building scalable, reusable code, collaborating with product owners on software design and implementation, contributing to product features, and mentoring colleagues.
Top Skills: AIAngularJavaJavaScriptReactVue
3 Minutes Ago
Remote or Hybrid
Hyderabad, Telangana, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
This role involves building scalable code, collaborating with product owners, enhancing products, and mentoring colleagues while integrating AI into processes.
Top Skills: Ai-Enhanced TechnologyAngularJavaJavaScriptReactVue

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account