TripleLift Logo

TripleLift

Senior Data Engineer

Posted 7 Days Ago
Be an Early Applicant
In-Office
Pune, Mahārāshtra
Senior level
In-Office
Pune, Mahārāshtra
Senior level
Build and optimize scalable data pipeline architecture supporting data and ML processes in production. Responsibilities include assembling complex datasets, developing ETL infrastructure with Spark, EMR, and Kafka, automating processes, improving scalability, and supporting data needs across engineering, product, BI, and data science teams. The role also involves data modeling, database technologies, and cross-functional technical collaboration.
The summary above was generated by AI
TripleLift is the Creative SSP powered by TL Spark, our agentic intelligence layer. We orchestrate creative, supply, audience, and measurement into a single outcome-driven system across the open internet, retail media, and CTV. Our platform enables brands and agencies to drive measurable performance while helping publishers maximize yield and preserve high-quality user experiences.
Overview

TripleLift is seeking a Senior Data Engineer to join a small, influential Data Engineering team.  This hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Senior Data Engineer will support our software engineers, product managers, business intelligence analysts and data scientists on data initiatives, and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.

Responsibilities
  • Create and maintain optimal data pipeline architecture,
  • Explore and assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Spark, EMR, Kafka and other big data technologies
  • Work with stakeholders across different teams, including product managers, engineers and analysts to assist with data-related technical issues and support their data infrastructure needs.

Education & Requirements
  • Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience.
  • Minimum of 5 years of professional software engineering experience, with a strong focus on data and ML processes running in production at scale.
  • Experience with optimizing big data and ML pipelines like Spark and Kafka at scale
  • Fundamental knowledge of ML and AI operations and processes. Experience in MLFlow, Feast, Ray, and other AI training technologies a plus
  • Understanding of a variety of database technologies such as OpenSearch, Druid, Clickhouse, InfluxDB, etc
  • Proven track record of cross-functional data modeling
  • Strong command of SQL and expertise in one or familiarity with multiple of the following languages: Python, Scala, Java
  • Experience in containerization, K8s and ArgoCD is a plus

At TripleLift, we believe great work starts with great people. We foster a culture built on collaboration, curiosity, and a shared commitment to making each other better. We move with urgency, challenge convention, and continuously innovate to elevate digital advertising. We value people who bring new perspectives, take ownership, and work together to drive meaningful impact. Learn more about TripleLift and our culture on our LinkedIn Life page.

Please review our Privacy Policy for information about how TripleLift handles personal information.

TripleLift does not accept unsolicited resumes from recruitment search firms. Any resume submitted without a signed agreement in place will become the property of TripleLift, and no fee will be due.

Similar Jobs

6 Days Ago
In-Office
Senior level
Senior level
Fintech • Financial Services
Designs and maintains scalable enterprise data pipelines, Spark-based processing frameworks, data models, cloud data platforms, and analytics solutions. The role contributes to architecture and technical design, ensures data governance and quality, optimizes large-scale workloads, supports CI/CD automation, and mentors junior engineers. Strong expertise in Spark/PySpark, SQL, enterprise data modeling, cloud ecosystems, and solution architecture is required.
Top Skills: AirflowSparkAWSAzure Data FactoryCi/CdData LakesDevOpsPysparkPythonSnowflakeSQL
6 Days Ago
In-Office
Senior level
Senior level
Software • Analytics
The Senior Data Engineer maintains and enhances databases, data warehouses, ETL pipelines, and real-time data processes. Responsibilities include improving data quality and performance, modernizing legacy data movement, documenting data systems, supporting governance and data protection, and producing analytical datasets. The role also supports machine learning adoption, code reviews, stakeholder documentation, and mentoring data team members while ensuring secure, scalable, and cost-effective data solutions.
Top Skills: AWSAws LambdaData WarehousingETLEvent BusMachine LearningMicrosoft Power PlatformPythonSQL Server
7 Days Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Financial Services
Modernize and optimize Spark data pipelines by migrating legacy Cloudera Hadoop workloads to Databricks on AWS. Design scalable data models and orchestration patterns, develop reusable components, improve performance, and apply engineering standards. Collaborate with architects, platform and DevOps teams, contribute to technical decisions, create automated tests, and support production releases and validation.
Top Skills: SparkAWSClouderaDatabricksDatabricks WorkflowsDelta LakeHadoopJavaPysparkScalaSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account