The Senior Product Support Engineer will design and optimize Hadoop and Spark-based systems, troubleshoot performance issues, and support migrations while working in a 24/7 environment.
Position Summary:
We are seeking a Product Specialist - Hadoop SME (Subject Matter Expert) who will be responsible for designing, optimising, migrating and scaling Hadoop and Spark-based data processing systems. This role involves hands-on experience with Hadoop and other core data operations, focusing on building resilient, high-performance distributed data systems. You will collaborate with customer engineering teams to deliver high-throughput Hadoop and Spark applications and solve complex data challenges in migration, upgrades, reliability, and optimise post-migration system performance.
If you’re passionate about working in fast-paced, dynamic environments and want to be part of the cutting edge of data solutions, this role is for you.
We’re looking for someone who can:
- Design and optimise distributed Hadoop-based applications, ensuring low-latency, high-throughput performance for big data workloads.
- Troubleshooting: Provide expert-level support for data or performance issues in Hadoop and Spark jobs and clusters.
- Data Processing Expertise: Work extensively with large-scale data pipelines using Hadoop and Spark's core components
- Performance Tuning: Conduct deep-dive performance analysis, debugging, and optimisation of Impala and Spark jobs to reduce processing time and resource consumption.
- Cluster Management: Collaborate with DevOps and infrastructure teams to manage Impala and Spark clusters on platforms like Hadoop/YARN, Kubernetes, or cloud platforms (AWS EMR, GCP Dataproc, etc.).
- Migration: Provide dedicated support to ensure the stability and reliability of the new ODP Hadoop environment during and after migration. Promptly address evolving technical challenges and optimise system performance after migration to ODP.
- This role requires flexibility to work in rotational shifts, based on team coverage needs and customer demand.
Candidates should be comfortable supporting operations in a 24/7 environment and be willing to adjust their working hours accordingly.
Similar Jobs
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Lead global ocean freight sourcing and category management: develop sourcing strategies, run tenders and negotiations, manage carrier relationships, analyze data for cost and performance improvements, mitigate supply chain risks, ensure compliance, and drive operational excellence across global stakeholders.
Top Skills:
CsoE-Sourcing PlatformsExcel
Cloud • Information Technology • Security • Software • Cybersecurity
Own technical relationships across the customer lifecycle: lead discovery, design bespoke architectures, run demos and PoCs across security, networking and developer platforms, drive adoption and expansion with quota responsibility, run technical QBRs, and leverage AI-augmented workflows to automate tasks and focus on strategic advisory.
Top Skills:
Ai AgentsApi ConnectorsCloud InfrastructureCloudflare Ai GatewayCloudflare WorkersDdos MitigationDnsJavaScriptLlm OrchestrationPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)Routing (Bgp)Telemetry Monitoring
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Support new DRAM/NAND products by coordinating test readiness, analyzing probe and electrical test data, performing root-cause analysis, recommending lot dispositions, defining characterization limits, and driving corrective actions across fab, design, and assembly processes.
Top Skills:
JmpPerlPython
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
