The role involves ensuring quality of AI solutions by designing test strategies, building automation frameworks, and validating enterprise applications performance.
We are looking for a highly skilled Senior QA Engineer/Lead with strong experience in testing Generative AI and Agentic AI solutions across enterprise platforms. In this role, you will ensure the quality, reliability, and performance of AI-powered capabilities such as autonomous agents, conversational experiences, RAG-based intelligence, and workflow automation. You will work closely with cross-functional teams to define testing strategies, build AI-aware automation frameworks, and validate implementations at scale across OCI, ServiceNow, Oracle Fusion, and custom enterprise applications
Responsibilities:
Responsibilities:
- Design and execute comprehensive test strategies to ensure the quality, reliability, and effectiveness of Generative AI and Agentic AI capabilities across enterprise use cases.
- Validate AI-driven workflows across ServiceNow ITSM modules, Oracle Fusion processes, and other enterprise applications, leveraging automation and conversational interactions.
- Test RAG-based intelligence for reliable context grounding and consistent retrieval performance
- Test Agentic AI behaviors to ensure appropriate task execution, autonomous decision quality, and safe workflow orchestration, and evaluate performance, scalability, and reliability of AI agents integrated across cloud and enterprise environments
- Build and maintain automation frameworks for API, functional, web, and backend testing. Integrate automation into CI/CD pipelines (Azure DevOps / GitHub / Jenkins)
- Create and maintain QA documentation, including test plans, test cases, traceability matrices, and execution reports
- Conduct performance and reliability testing for AI endpoints and automations across workloads
- Diagnose failures, analyze patterns, and drive issue resolution by collaborating with platform and engineering teams
- Drive continuous improvement by adopting advanced AI testing practices and metrics suitable for nondeterministic systems
- Stay current with advancements in AI testing tools, automation accelerators, and emerging testing standards
- 8+ years of experience in QA with 2+ years of testing Generative AI / Agentic AI / ML-based systems
- Hands-on experience validating AI workflows in one or more enterprise ecosystems such as ServiceNow, Oracle Fusion, or cloud-native platforms
- Strong scripting and automation skills (Python preferred) with experience in frameworks like Selenium, Playwright, REST Assured, or PyTest
- Knowledge of LLM architectures, NLP behavior, RAG workflows, and vector retrieval validation
- Proficiency with Git, CI/CD pipelines, Docker/Kubernetes for enterprise automation support
- Expert in QA including test design, defect lifecycle, and quality metrics
- Knowledge of Responsible AI, bias/fairness testing, and governance practices
- Strong communication skills to explain testing results and quality improvements clearly
- Ability to guide and support team members on testing best practices
Top Skills
Agentic Ai
Azure Devops
Ci/Cd
Docker
Generative Ai
Git
Git
Jenkins
Kubernetes
Playwright
Pytest
Python
Rest Assured
Selenium
Similar Jobs
Financial Services
Lead a team focused on incident, change, and problem management in infrastructure support. Manage communications, client relationships, and process improvements while mentoring staff and aligning goals with GTI strategy.
Top Skills:
AnsibleAristaCheckpointCi/CdCisco AciCisco PrimeDnaF5FortinetHa ProxyPythonServicenowSevoneSnmpSplunkVxlan
Financial Services
The Global Custody Tax Product Manager will manage the custody tax product, oversee regulatory changes, lead projects, and collaborate with various teams to ensure effective delivery of tax solutions.
Top Skills:
Tax Intelligence Platform
Financial Services
Lead technical program manager responsible for delivering technology projects, managing resources, budgets, and fostering innovation in a dynamic environment.
Top Skills:
Agile
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
