Rapid7 Logo

Rapid7

Senior Platform AI Engineer

Job Posted 3 Days Ago Reposted 3 Days Ago
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in Pune, Maharashtra
Senior level
Remote or Hybrid
Hiring Remotely in Pune, Maharashtra
Senior level
Lead the design and development of AI prompts and agents, integrate LLM tools into systems, and optimize performance while ensuring compliance and documentation.
The summary above was generated by AI
Overview
We are looking for a hybrid AI Platform Engineer to lead the design of high-performance prompts and the development of custom AI agents and integrations across our internal platforms. Collaborating closely with our AI Platform Manager and functional business units, this role bridges the creative precision of prompt engineering with the technical fluency required to build and deploy powerful LLM-based tools using APIs, system integrations, and emerging AI infrastructure.
Key Responsibilities
  • Prompt Engineering & Optimization
    • Design, test, and refine prompts for general and use-case-specific applications.
    • Evaluate and improve LLM output quality based on accuracy, latency, hallucination, and user satisfaction.
    • Maintain a scalable prompt library with robust documentation and experimentation tracking.
  • Custom Agent & GPT Development
    • Build and maintain custom GPTs (via OpenAI) or Google Agents (Gemini, Vertex AI).
    • Configure tools, memory, system prompts, and API-calling capabilities for agent workflows.
    • Ensure agents follow internal data governance and compliance policies.
  • API & Platform Integration
    • Integrate LLM functionality into internal systems (e.g., dashboards, Slack, CRMs, internal portals).
    • Work with APIs from OpenAI, Google Cloud, Azure, and others to create functional pipelines.
    • Support rapid prototyping and deployment of AI features in close coordination with product and automation teams.
  • Evaluation & Instrumentation
    • Define key performance metrics (quality, reliability, usage patterns).
    • Collaborate with data engineering to log, analyze, and visualize LLM performance.
    • Implement feedback loops to continuously optimize prompt and agent behavior.
  • Enablement & Documentation
    • Provide tooling and guidance to business users and product teams for prompt-based workflows.
    • Contribute to internal AI playbooks and best practices around prompt usage and API integration.

Requirements
  • 5+ years of experience in AI/ML, NLP applications, or full-stack product development
  • Hands-on experience with OpenAI APIs, Google Cloud Vertex/Gemini, or similar platforms
  • Strong experience with prompt engineering and LLM evaluation methods
  • Proficiency in Python and working with APIs, JSON, and vector databases
  • Familiarity with LangChain, LlamaIndex, or custom agent frameworks
  • Excellent collaboration and communication skills

Top Skills

AI
Gemini
GCP
JSON
Langchain
Llamaindex
Openai Apis
Python
Vector Databases
Vertex Ai

Similar Jobs at Rapid7

2 Days Ago
Remote or Hybrid
Pune, Maharashtra, IND
Mid level
Mid level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
The Sr. Security Engineer will design and integrate security controls, manage vulnerabilities, and provide consulting across business units to enhance security measures.
Top Skills: AWSFirewallGoLinuxmacOSNetwork SwitchesPythonWindows
2 Days Ago
Remote or Hybrid
Pune, Maharashtra, IND
Junior
Junior
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
As a Detection and Response Analyst, you'll investigate and analyze security events, conduct malware analysis, and produce incident reports.
Top Skills: BloodhoundLinux)macOSMetasploitMimikatzMitre Att&Ck FrameworkOperating Systems (WindowsRapid7 Software
2 Days Ago
Remote or Hybrid
Pune, Maharashtra, IND
Junior
Junior
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
As a Detection and Response Analyst, you will investigate malicious activity using advanced tools, conduct incident analysis, and collaborate with team members to enhance cybersecurity efforts.
Top Skills: BloodhoundMetasploitMimikatzMitre Att&CkRapid7

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account