NVIDIA Logo

NVIDIA

Senior Solutions Architect - Generative AI

Posted 2 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
Senior level
Bengaluru, Bengaluru Urban, Karnataka
Senior level
The Senior Solutions Architect will design and implement generative AI solutions focusing on training and optimizing Large Language Models (LLMs) and developing Retrieval-Augmented Generation (RAG) workflows. The role involves close collaboration with customers, leading workshops, and providing technical guidance while leveraging NVIDIA's generative AI technologies to solve complex language-related business challenges.
The summary above was generated by AI

NVIDIA is seeking a dynamic and experienced Generative AI Solution Architect with specialized expertise in training Large Language Models (LLMs) and implementing workflows based on Pretraining, Finetuning LLMs & Retrieval-Augmented Generation (RAG). As a key member of our AI Solutions team, you will play a pivotal role in architecting and delivering cutting-edge solutions that leverage the power of NVIDIA's generative AI technologies. This position requires a deep understanding of language models, particularly open source LLMs, and a strong proficiency in designing and implementing RAG-based workflows.
What You Will Be Doing:

  • Architect end-to-end generative AI solutions with a focus on LLMs training , deployment and RAG workflows.

  • Collaborate closely with customers to understand their language-related business challenges and design tailored solutions.

  • Collaborate with sales and business development teams to support pre-sales activities, including technical presentations and demonstrations of LLM and RAG capabilities.

  • Work closely with NVIDIA engineering teams to provide feedback and contribute to the evolution of generative AI software.

  • Engage directly with customers/partners to understand their requirements and challenges.

  • Lead workshops and design sessions to define and refine generative AI solutions focused on LLMs and RAG workflows and lead the training and optimization of Large Language Models using NVIDIA’s hardware and software platforms.

  • Implement strategies for efficient and effective training of LLMs to achieve optimal performance.

  • Design and implement RAG-based workflows to enhance content generation and information retrieval.

  • Work closely with customers to integrate RAG workflows into their applications and systems and stay abreast of the latest developments in language models and generative AI technologies.

  • Provide technical leadership and guidance on best practices for training LLMs and implementing RAG-based solutions.

What We Need To See:

  • Master's or Ph.D. in Computer Science, Artificial Intelligence, or equivalent experience

  • 7+ years of hands-on experience in a technical AI role, specifically focusing on generative AI, with a strong emphasis on training Large Language Models (LLMs).

  • Proven track record of successfully deploying and optimizing LLM models for inference in production environments.

  • In-depth understanding of state-of-the-art language models, including but not limited to GPT-3, BERT, or similar architectures.

  • Expertise in training and fine-tuning LLMs using popular frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.

  • Proficiency in model deployment and optimization techniques for efficient inference on various hardware platforms, with a focus on GPUs.

  • Strong knowledge of GPU cluster architecture and the ability to leverage parallel processing for accelerated model training and inference.

  • Excellent communication and collaboration skills with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.

  • Experience leading workshops, training sessions, and presenting technical solutions to diverse audiences.

Ways To Stand Out From The Crowd:

  • Experience in deploying LLM models in cloud environments (e.g., AWS, Azure, GCP) and on-premises infrastructure.

  • Proven ability to optimize LLM models for inference speed, memory efficiency, and resource utilization.

  • Familiarity with containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes) for scalable and efficient model deployment.

  • Deep understanding of GPU cluster architecture, parallel computing, and distributed computing concepts.

  • Hands-on experience with NVIDIA GPU technologies, and GPU cluster management and ability to design and implement scalable and efficient workflows for LLM training and inference on GPU clusters

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you!

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

Top Skills

PyTorch
TensorFlow

Similar Jobs

2 Days Ago
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The Senior Solutions Architect for Generative AI at NVIDIA will architect and deliver generative AI solutions focused on Large Language Models. Responsibilities include collaborating with customers, leading design workshops, implementing RAG workflows, and optimizing LLM training using NVIDIA's technologies. A strong focus on deploying models in production environments is essential.
Top Skills: PyTorchTensorFlow
An Hour Ago
Bengaluru, Karnataka, IND
Senior level
Senior level
Aerospace • Cloud • Digital Media • Information Technology • Mobile • News + Entertainment • Retail
The Lead Engineer will design and develop automated AWS environments, support system operations, optimize performance, and manage security protocols. Responsibilities include contributing to system documentation, troubleshooting outages, maintaining high availability, and executing application support for product customers.
Top Skills: AWSJavaScriptPython
2 Hours Ago
Bengaluru, Karnataka, IND
Mid level
Mid level
Aerospace • Cloud • Digital Media • Information Technology • Mobile • News + Entertainment • Retail
The role involves data analysis, developing and optimizing Tableau dashboards, managing platform upgrades, deploying data sources, and resolving issues with Tableau support. Additionally, the position includes monitoring reporting tools and implementing new technologies in a distributed enterprise environment.
Top Skills: SQLTableau

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account