Sutherland Logo

Sutherland

QA Engineer

Posted 9 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Own technical testing of AI agent outputs by building validation suites against golden-record datasets, tracking accuracy and turnaround-time metrics, and performing regression testing after agent or prompt changes. The role supports regulated-process quality assurance by providing technical evidence and findings for human QA sign-off. Candidates should have substantial QA or test engineering experience, including validation of ML or LLM outputs and benchmark dataset development for document or text-processing systems.
The summary above was generated by AI
Company Description

About Sutherland

Artificial Intelligence. Automation.Cloud engineering. Advanced analytics.For business leaders, these are key factors of success. For us, they’re our core expertise.

We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence.

We’ve created over 200 unique inventions under several patents across AI and other critical technologies. Leveraging our advanced products and platforms, we drive digital transformation, optimize critical business operations, reinvent experiences, and pioneer new solutions, all provided through a seamless “as a service” model.

For each company, we provide new keys for their businesses, the people they work with, and the customers they serve. We tailor proven and rapid formulas, to fit their unique DNA.We bring together human expertise and artificial intelligence to develop digital chemistry. This unlocks new possibilities, transformative outcomes and enduring relationships.
Sutherland

Unlocking digital performance. Delivering measurable results.

Job Description

Role Summary

Owns technical testing of agent outputs — accuracy, turnaround-time impact, and regression testing as agents are iterated — feeding the accuracy and completion-time KPIs tracked at the programme level.

Key Responsibilities

  • Build test suites validating agent outputs against golden-record datasets across covered processes.
  • Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
  • Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
  • Feed findings into the human QA function for final sign-off — this role supports human QA authority on regulated activity with technical evidence, not replaces it.

Qualifications

Required Experience

  • 5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
  • Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
  • Domain process familiarity a plus for building realistic test scenarios.

Sutherland Chennai, Tamil Nadu, IND Office

Gateway office Parks,, A6, 6th Floor, A1, GF, 5th,6th & 7th , B2 block, # 16, GST Road, Perungalathur,, , Chennai, TN , India, 600063

Sutherland Chennai, Tamil Nadu, IND Office

Chennai, India

Sutherland Tambaram, Tamil Nadu, IND Office

GST Road, Tambaram, Tamil Nadu, India, 600045

Similar Jobs

2 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Entry level
Entry level
Information Technology
Develop and enhance automated testing scripts; create test plans and cases; configure test beds; execute and document functional, integration, regression, performance, interoperability, and system tests; investigate issues through reproduction and debugging with developers; report results, update quality metrics, and improve testing strategies.
Top Skills: 802.11Api TestingBashCypressEmbedded SystemsIotIperfIxiaLanforgeNetworkingOctoscopePyatsPythonRobot FrameworkUi AutomationVeriwaveWiresharkWlan
2 Days Ago
Hybrid
Chennai, Tamil Nadu, IND
Expert/Leader
Expert/Leader
Software
Designs, plans, automates, and executes functional, integration, performance, load, and scale testing for cloud-based networking applications. Tests APIs, GUIs, microservices, wired and wireless networking protocols, security features, and customer deployments. Develops end-to-end automation, reviews test code, investigates defects, and collaborates with product, development, and cloud operations teams. Requires strong programming, cloud, containerization, performance testing, database, monitoring, and Linux expertise.
Top Skills: 802.1XAaaApache IgniteAWSBgpDockerEtherealGitGitGoGCPGrafanaHyper-VIpIs-IsJavaJmeterKubernetesLinuxLocustAzureMplsNoSQLOspfPerlPlaywrightPostgresPrometheusPythonRedisRest ApisRobot FrameworkSeleniumSpbmSQLSslStpTcl/TkTcpUdpUnixVlanVmware EsxVpnVrrpWireshark
3 Days Ago
In-Office or Remote
India
Senior level
Senior level
Artificial Intelligence • Fintech • Machine Learning • Software • App development • Conversational AI • Generative AI
Drive quality assurance for web features from technical handoff through production release. Responsibilities include test planning, test case creation, functional and exploratory testing, regression, UI/UX, cross-browser, responsive, API, and end-to-end testing. Support releases through build validation and monitoring, document and review tests, collaborate with product and engineering teams, improve QA metrics, and optionally contribute to test automation.
Top Skills: Allure TestopsCharlesChromeCypressDomEdgeFiddlerFirefoxGitGraphQLHttp/HttpsJavaScriptJIRAPlaywrightPostmanProxymanPythonRestSafariSeleniumTypescript

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account