DataPelago

Data Processing Quality Engineer

Reposted 13 Days Ago

Be an Early Applicant

In-Office

Hyderābād, Telangāna

Senior level

In-Office

Hyderābād, Telangāna

Senior level

Ensure the quality of the data processing engine by testing for result accuracy, performance fidelity, and robust execution through various methodologies.

The summary above was generated by AI

Ensure quality of the data processing engine, in terms of result accuracy, performance fidelity, and robust execution at scale.

Requirements

• BS EE/CS or equivalent

• 5+ years of experience in data processing quality or performance testing for database, data warehouse, or query engine applications. Experience testing for platforms such as Apache Spark, Gluten, Velox, DataFusion preferred.

• Solid knowledge of SQL, Python, and similar data processing languages

• Automation-first mindset, experienced with programming/scripting languages and automation tools.

• Strong in problem-solving and coming up with the test strategy for the complex system.
• Strong in debugging, root cause, and narrowing down the failures.

• Experience in Functional, Performance, Integration, System Level testing
• Experience with the use of public cloud platforms such as AWS, GCP, and MS Azure

• Good Knowledge of tools like Jira, Confluence, Git, Jenkins.
• Good understanding of SDLC and agile methodologies.
• Good understanding of CI/CD implementations.

Top Skills

Spark

AWS

Confluence

Datafusion

GCP

Git

Gluten

Jenkins

JIRA

Ms Azure

Python

SQL

Velox

Similar Jobs

Ecolab

Account Manager

2 Days Ago

In-Office

Hyderābād, Telangāna, IND

Mid level

Biotech

As a Technical Sales Representative, you will drive revenue growth and build relationships with customers through consultative sales and technical support.

Top Skills: Data AnalysisSales ProcessesSystem Analysis

System Soft Technologies

Automation Engineer

6 Days Ago

In-Office

Hyderābād, Telangāna, IND

Senior level

Software

Lead the Intelligent Automation team, managing all phases of RPA development while guiding strategy, innovation, and team dynamics. Hands-on development required.

Top Skills: Automation AnywhereAutomation EdgeBlueprismC#C++JavaJavaScriptPythonUipathVb Script

DataPelago

Customer Success Manager

8 Days Ago

In-Office

Hyderābād, Telangāna, IND

Mid level

Software

As a Customer Success Manager, ensure customer outcomes with DataPelago’s analytics engine by driving adoption, building relationships, and guiding integrations.

Top Skills: Ai/MlApache IcebergAWSAzureDelta LakeGCPJavaLakehouse PlatformsPythonScalaSparkSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.