Quantiphi Logo

Quantiphi

Senior Data Engineer (Elasticsearch/SQL)

Posted 3 Days Ago
Be an Early Applicant
In-Office
3 Locations
Senior level
In-Office
3 Locations
Senior level
The Senior Data Engineer will design optimized search and analytics solutions with Elasticsearch and SQL, manage data pipelines, troubleshoot issues, and develop APIs, ensuring smooth operations with various teams.
The summary above was generated by AI

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

 Role: Senior Data Engineer - (SQL/Elasticsearch)

Experience : 3 - 8 Years

Work location: Mumbai, Bangalore & Trivandrum

Role & Responsibilities:

  • Design and optimize search and analytics solutions using Elasticsearch for handling structured, semi-structured, and unstructured healthcare data.

  • Build and optimize SQL-based ETL/ELT pipelines for ingestion, transformation, and reporting at scale.

  • Diagnose and troubleshoot distributed systems problems, including search performance, query optimization, and data indexing challenges.

  • Design and implement scalable storage and query solutions leveraging relational databases and search engines.

  • Help developers in debugging data related issues.

  • Capable of creating APIs using Python(fastAPI).

  • Communicate effectively with Infrastructure, Network, DevOps, SiteOps, and customer teams to ensure smooth operations.

  • Build automation and monitoring tools to ensure high availability and performance of SQL and Elasticsearch-based systems.

Must Have Skills:

  • Strong expertise in SQL (query optimization, stored procedures, indexing, partitioning).

  • Hands-on experience with Elasticsearch: designing indices, mapping, analyzers, query DSL, performance tuning, scaling clusters.

  • Solid understanding of data modeling, normalization, and search schema design.

  • Proficiency in Python for scripting and API development.

  • Familiarity with GitHub/Bitbucket/GitLab for version control.

  • Strong grasp of data structures, exception handling, and debugging.

  • Experience with GCP services (BigQuery, Data Fusion, Pub/Sub, Cloud Storage) or equivalent AWS/Azure data services.

  • Exposure to orchestration frameworks such as Airflow, NiFi, or Google Cloud Composer.

  • Experience developing pipelines and utilities for data migration, storage, search, and analytics on Google Cloud.

  • Experience in developing and maintaining large-scale data ingestion pipelines capable of handling terabytes of daily data.

  • Familiarity with message/event streaming solutions such as Kafka, Kinesis, or Pub/Sub.

  • Knowledge of containerization and orchestration (Docker, Kubernetes).

  • Hands-on experience in optimizing Elasticsearch clusters for high availability, security, and scalability in production.

  • Experience supporting large-scale, real-time data systems in production.

 

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

Airflow
AWS
Azure
Docker
Elasticsearch
GCP
Git
Kafka
Kinesis
Kubernetes
Nifi
Python
SQL

Similar Jobs

9 Hours Ago
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
Expert/Leader
Expert/Leader
Enterprise Web • Fintech • Financial Services
The Enterprise Architect will design integrated workflows and systems across departments, guiding technical teams in architecting enterprise solutions to enhance operational performance.
Top Skills: Amazon Web ServicesBoomiCmsDamErp SystemsFlowgearGoogle Cloud PlatformJavaMarketoPrismaticPythonRedshiftSalesforceSnowflakeWorkato
9 Hours Ago
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
Senior level
Senior level
Enterprise Web • Fintech • Financial Services
Lead engineering efforts in enterprise automation for Sales and Finance technologies, build and coach teams, ensuring robust integrations and high-quality performance.
Top Skills: AWSBillingCatalystCpqDockerErpGainsightGCPJavaKafkaKubernetesOpenapiPythonRestSalesforceSnowflakeSQLWorkato
9 Hours Ago
Hybrid
Navi Mumbai, Thane, Maharashtra, IND
Junior
Junior
Enterprise Web • Fintech • Financial Services
The Software Engineer will develop and maintain Credit products, ensure timely quality deliveries, and work with global teams using Agile methodology.
Top Skills: .NetAngularDevOpsFast ApiGitJenkinsPythonVuejs

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account