Lead end-to-end architecture for an agentic testing AI platform: design multi-agent orchestration, tool interfaces and sandboxing, evaluation and safety (red-teaming, guardrails), model and vector strategy, and ensure reliability, latency, cost, observability, and data privacy while partnering with product and AI leadership.
• Years of experience: 10+ years total; 5+ in AI/ML systems; 2+ with LLMs/agentic systems. • Summary: Own the end-to-end technical architecture for a testing agentic AI platform: multi-agent orchestration, tool interfaces, safety, observability, and scalable deployment. • Responsibilities: a. Define multi-agent system architecture (planner, executor, memory, tool adapters) and governance. b. Design tool-use layer (APIs, search, code, test frameworks) and secure sandboxing, reflecting that agentic systems act via tools and feedback loops c. Establish evaluation and safety architecture (guardrails, red-teaming, policy engines) for non-deterministic behavior and human-in-the-loop review d. Select model strategy (proprietary vs OSS), vector/store strategy, and retrieval patterns. e. Drive platform non-functionals: reliability, latency, cost, observability, and data privacy. f. Partner with PO/AI Lead on roadmap and technical debt management; collaborate with product to design, test, and deploy AI capabilities • Technical skills: a. LLM/agent frameworks (LangChain/LlamaIndex), multi-agent orchestration, tool-calling, function calling. b. Retrieval + memory: vector DBs (FAISS, Milvus, pgvector), embeddings. c. Evaluation/LLMOps: prompt/versioning, offline/online evals, MLflow/W&B, feature stores. d. Systems: distributed services, eventing, gRPC/REST, Kubernetes, Terraform, observability. e. Security/compliance: data governance, PII handling, secrets, guardrails. • Domain skills: a. Software testing/QA platforms, test orchestration, CI/CD integration. b. Agentic behavior patterns and test generation/coordination at scale
Hexaware Technologies Chennai, Tamil Nadu, IND Office
MCN Nagar Ext, MCN Nagar Extension, Thoraipakkam, Chennai, Tamil Nadu, India, 600097
Similar Jobs
Information Technology • Consulting
Lead development of generative AI models: fine-tune and train models using TensorFlow/PyTorch/Keras, prevent overfitting with regularization, integrate AI into apps and services, optimize for low-latency real-time use, and collaborate via Git.
Top Skills:
GitKerasPyTorchTensorFlow
Information Technology • Consulting
Lead development of generative AI solutions: fine-tune and train deep learning models, prevent overfitting with regularization, integrate AI into applications and services, and optimize model performance and latency for real-time use. Collaborate using version control.
Top Skills:
GitKerasPyTorchTensorFlow
Information Technology • Consulting
As a Gen AI Lead Developer, you will fine-tune and train models using frameworks like TensorFlow, PyTorch, or Keras, integrate AI functionalities into applications, and optimize model performance.
Top Skills:
GitKerasPyTorchTensorFlow
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
