DataPelago

Data Processing Quality Engineer

Reposted 2 Days Ago

Be an Early Applicant

In-Office

Hyderābād, Telangāna

Senior level

In-Office

Hyderābād, Telangāna

Senior level

Ensure the quality of the data processing engine by testing for result accuracy, performance fidelity, and robust execution through various methodologies.

The summary above was generated by AI

Ensure quality of the data processing engine, in terms of result accuracy, performance fidelity, and robust execution at scale.

Requirements

• BS EE/CS or equivalent

• 5+ years of experience in data processing quality or performance testing for database, data warehouse, or query engine applications. Experience testing for platforms such as Apache Spark, Gluten, Velox, DataFusion preferred.

• Solid knowledge of SQL, Python, and similar data processing languages

• Automation-first mindset, experienced with programming/scripting languages and automation tools.

• Strong in problem-solving and coming up with the test strategy for the complex system.
• Strong in debugging, root cause, and narrowing down the failures.

• Experience in Functional, Performance, Integration, System Level testing
• Experience with the use of public cloud platforms such as AWS, GCP, and MS Azure

• Good Knowledge of tools like Jira, Confluence, Git, Jenkins.
• Good understanding of SDLC and agile methodologies.
• Good understanding of CI/CD implementations.

Top Skills

Spark

AWS

Confluence

Datafusion

GCP

Git

Gluten

Jenkins

JIRA

Ms Azure

Python

SQL

Velox

Similar Jobs

Johnson Controls

Sr. Manager-CFS Commercial Sales

7 Hours Ago

In-Office

Hyderābād, Telangāna, IND

Senior level

Other • Security

Responsible for sales and business development in the western region for the commercial vertical, promoting various systems and meeting sales targets.

Top Skills: Building Management SystemsElectronic Security SystemsFire Alarm SystemsHvacPublic Address Systems

The Flex

Customer Experience Representative - Asia

5 Days Ago

In-Office

Entry level

Artificial Intelligence • Real Estate • Software

As a Customer Experience Representative, you will be the first contact for guests and landlords, ensuring effective communication, problem-solving, and overall satisfaction during the rental process.

Top Skills: CRMPms

The Flex

Founder’s Associate – Remote

7 Days Ago

In-Office or Remote

Entry level

Artificial Intelligence • Real Estate • Software

The Founder’s Associate will support the Founder & CEO in executing initiatives across operations, strategy, and growth while gaining exposure to various business functions.

Top Skills: Property Management System (Pms)

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.