DataPelago Logo

DataPelago

Data Processing Quality Engineer

Job Posted 18 Days Ago Posted 18 Days Ago
Be an Early Applicant
In-Office
Hyderābād, Telangāna
Senior level
In-Office
Hyderābād, Telangāna
Senior level
The role focuses on ensuring the quality of data processing engines, emphasizing accuracy, performance, and robust execution. Responsibilities include developing test strategies, debugging, and conducting various testing types.
The summary above was generated by AI

Ensure quality of the data processing engine, in terms of result accuracy, performance fidelity, and  robust execution at scale.  

Requirements  

BS EE/CS or equivalent 

5+ years of experience in data processing quality or performance testing for database,  data warehouse, or query engine applications.  Experience testing for platforms such as  Apache Spark, Gluten, Velox, DataFusion preferred.  

Solid knowledge of SQL, Python, and similar data processing languages  

Automation-first mindset, experienced with programming/scripting languages and  automation tools.  

Strong in problem-solving and coming up with the test strategy for the complex system. 
Strong in debugging, root cause, and narrowing down the failures.  

Experience in Functional, Performance, Integration, System Level testing 
Experience with the use of public cloud platforms such as AWS, GCP, and MS Azure 

Good Knowledge of tools like Jira, Confluence, Git, Jenkins. 
Good understanding of SDLC and agile methodologies. 
Good understanding of CI/CD implementations.

Top Skills

Spark
AWS
Confluence
Datafusion
GCP
Git
Gluten
Jenkins
JIRA
Ms Azure
Python
SQL
Velox

Similar Jobs

5 Days Ago
In-Office
Hyderābād, Telangāna, IND
Senior level
Senior level
Software
The Solution Architect will guide customers in adopting the engine, collaborate with engineering, and mentor junior architects while driving sales success through technical evaluation and customer engagement activities.
Top Skills: Ai/MlAWSAzureData PipelinesDatabricks Unity CatalogDelta Live TablesDelta MergeGCPHive MetastoreJavaLakehousePythonScalaSparkSQLSQL
5 Days Ago
In-Office
Hyderābād, Telangāna, IND
Senior level
Senior level
Software
Lead the design and implementation of ServiceNow solutions, providing technical guidance and ensuring alignment with business objectives.
Top Skills: CSSHTMLJavaScriptServicenow
5 Days Ago
In-Office
Hyderābād, Telangāna, IND
Senior level
Senior level
Software
The role involves leading a software engineering team, developing innovative solutions, mentoring staff, and maintaining coding standards within Agile methodologies.
Top Skills: .Net Framework,.Net Core,C#,Javascript,React,Sql,Entity Framework,Linq,Visual Studio

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account