Numerator Logo

Numerator

Sr. Data Engineer

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Design, build, and optimize high-volume data pipelines using Python, Databricks and Spark on Azure. Create and maintain automation test suites (Azure DevOps), perform manual/load/exploratory testing, collaborate with BAs and developers to meet sprint goals, and assist with sprint estimation and delivery.
The summary above was generated by AI

 We’re reinventing the market research industry. Let’s reinvent it together.

At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

We are seeking a highly skilled Senior Data Engineer with extensive experience in designing, building, and optimizing high-volume data pipelines. The ideal candidate will have strong expertise in Python, Databricks on Azure Cloud services, DevOps, and CI/CD tools, along with a solid understanding of AI/ML techniques and big data processing frameworks like Apache Spark and PySpark.

Responsibilities

  • Adhere to coding and Numerator technology standards 

  • Build suitable automation test suites within Azure DevOps 

  • Maintain and update automation test suites as required 

  • Carry out manual testing, load testing, exploratory testing as required 

  • Work closely with Business Analysts and Senior Data Developers to consistently achieve sprint goals 

  • Assist in estimation of sprint-by-sprint stories and tasks 

  • Pro-actively take a responsible approach to product delivery

Requirements

  • 7-10 years of experience in data engineering roles

  • Good Python skills 

  • Experience working with Microsoft Azure Cloud 

  • Experience in Agile methodologies (Scrum/Kanban)

  • Experience with Apache Spark, PySpark, Databricks 

  • Experience working with Devops pipeline, preferably Azure DevOps

Preferred Qualifications

  • Bachelor's or master's degree in computer science, Information Technology, Data Science, or a related field.

  • Experience working in a support focused role 

  • Knowledge/experience in AI ML techniques

  • Certification in relevant Data Engineering discipline or related fields.

There is strength in numbers - We are the Numerati

Numerator is 5,800 employees strong. We have the confidence to be real and embrace what makes each Numerati unique. Our diverse experiences, ideas and backgrounds fuel our innovation.

Being part of the Numerati means that we’ll take care of you! From our Recharge Days, maximum flexibility policy, wellness resources for employees and their families, development opportunities and much more — we’re always finding ways to better support, celebrate and accelerate our team.

Similar Jobs

24 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.
Top Skills: Aws EksAws RdsAws S3DockerDtcc RttmDtcc Settlement WebEtl/Elt FrameworksFixFxmlIbm MqIso 15022KafkaKubernetesRest ApisSQL ServerUnified Trade Record (Utr)
2 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Information Technology • Consulting
Design, develop, and deploy data engineering solutions and analytics pipelines on Databricks. Build data models, optimize SQL and DAX queries, manage ETL and real-time ingestion, tune performance for large data volumes, and produce dashboards and reports while cross-training team members.
Top Skills: SparkDatabricksDatabricks DevopsDaxDelta LakeDelta TablesPandasParquetPysparkPythonSQL
3 Days Ago
Remote
Shri Bhrigukshetra, BLR, Uttar Pradesh, IND
Senior level
Senior level
Fintech • Analytics
Support and troubleshoot large-scale data ingestion, transformation, and delivery pipelines; manage job schedules and workflows; analyze incidents and drive resolutions or escalations; collaborate with engineering to improve pipeline stability and performance; provide client-facing technical support. Role requires working US shift (6:30 PM–3:30 AM IST).
Top Skills: Amazon AthenaApache AirflowAws Ec2Aws EcsAws EksAws RedshiftData LakeDremioETLGit (GitlabGithub)JenkinsKubernetesLinuxPythonRundeckSnowflake

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account