Design and implement production-grade AI agent harnesses, build and operate MLOps pipelines with Kubeflow, fine-tune foundation LLMs (LoRA/QLoRA, SFT, RLHF), deploy and manage services on Kubernetes, integrate agent frameworks, and apply software engineering best practices to move models from prototype to production.
We're hiring a Software Engineer to build the infrastructure that powers our AI agents and ML systems end-to-end — from fine-tuning foundation models to shipping production-grade agent harnesses. You'll work across the stack: building MLOps pipelines, customizing LLMs, and deploying scalable agent systems on Kubernetes. This role sits at the intersection of ML engineering, platform engineering, and applied AI.
Responsibilities- Design and build agent harnesses in Python — the runtime scaffolding that enables AI agents to perceive, reason, plan, and act reliably
- Develop and maintain a robust MLOps framework using Kubeflow and complementary tooling (MLflow, Argo, Airflow, or similar) to orchestrate training, evaluation, and deployment workflows
- Fine-tune foundation LLMs using techniques such as LoRA/QLoRA, SFT, and RLHF; manage datasets, training runs, and evaluation pipelines
- Deploy and operate services on Kubernetes, including model serving, autoscaling, and observability
- Build and integrate AI agents using modern agent frameworks (LangGraph, CrewAI, AutoGen, LlamaIndex, or similar)
- Apply software engineering rigor — SOLID principles, secure coding, static analysis, code reviews, and CI/CD — across all deliverables
- Collaborate with researchers, ML engineers, and product teams to take prototypes from notebook to production
Must to Have:
- Bachelor’s or Master’s degree in Engineering, along with around 6+ years of experience in Python development, including building and supporting production systems
- Hands-on experience working with agent-based or agentic systems, using at least one framework such as LangGraph, CrewAI, AutoGen, LangChain, or LlamaIndex
- Exposure to designing or contributing to MLOps pipelines, with familiarity with tools like Kubeflow
- Practical experience in fine-tuning large language models (for example, open-source models like Llama, Mistral, Qwen, or similar)
- Experience deploying containerized applications on Kubernetes, including areas like Helm, operators, networking, and resource management
- Familiarity with at least one major cloud platform (AWS, GCP, or Azure), including services related to compute, storage, identity access management, and machine learning
- Understanding of software engineering practices such as modular design (SOLID principles), design patterns, secure coding practices, static analysis tools (for example, mypy, ruff, Bandit, SonarQube), and testing approaches (unit and integration testing)
Nice to Have:
- Exposure to distributed training approaches, using tools such as DeepSpeed, FSDP, or Accelerate
- Familiarity with vector databases, retrieval-augmented generation (RAG) systems, and evaluation frameworks for language models
- Experience working with model serving solutions such as vLLM, TGI, KServe, or Triton
Advancing connectivity to secure a brighter world.
Nokia is a global leader in connectivity for the AI era. With expertise across fixed, mobile and transport networks, powered by the innovation of Nokia Bell Labs, we’re advancing connectivity to secure a brighter world.
Learn more about life at Nokia.
Our recruitment process
We act inclusively and respect the uniqueness of people. Our employment decisions are made regardless of race, color, national or ethnic origin, religion, gender, sexual orientation, gender identity or expression, age, marital status, disability, protected veteran status or other characteristics protected by law. We are committed to a culture of inclusion built upon our core value of respect.
If you’re interested in this role but don’t meet every listed requirement, we still encourage you to apply. Unique backgrounds, perspectives, and experiences enrich our teams, and you may be just the right candidate for this or another opportunity.
The length of the recruitment process may vary depending on the specific role's requirements. We strive to ensure a smooth and inclusive experience for all candidates. Discover more about the recruitment process at Nokia.
Some of our benefits in India:
- Flexible and hybrid working arrangements to support work–life balance
- Health and well-being support – medical insurance for you and your family, health check-ups, life and accident insurance, well-being programs, and employee resource groups
- A minimum of 90 days of Maternity and Paternity Leave based on eligibility
- Personal Support Service 24/7 – a confidential support channel open to all Nokia employees and their families in challenging situations
- Career growth & mobility – technical career paths, job rotations, international assignments, and relocation support
- Continuous learning – technical certifications, mentoring programs, coaching, and digital learning platforms
- Opportunities to innovate and contribute through Nokia’s research and development environment
- Recognition programs that celebrate outstanding contributions
- Workplace support – ergonomic working support and mobile device programs based on eligibility
Nokia Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Build and deploy AI-powered customer solutions across discovery, prototyping, and production. Responsibilities include designing secure multi-tenant and hybrid architectures, integrating identity and access management, encryption, networking, data engineering, CI/CD, observability, and production support. The role partners directly with enterprise customers, executive sponsors, and cross-functional teams to solve ambiguous problems, demonstrate prototypes, and standardize successful solutions. Regular domestic and occasional international travel is required.
Top Skills:
Api GatewaysAWSCi/CdDockerDuckdbFastmcpJavaKafkaKubernetesLangchainLanggraphMcpMtlsPgvectorPostgresPrivatelinkPythonRagTypescriptVpc Peering
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Build and operate production-grade AI data pipelines and financial knowledge services for equities content. Responsibilities include processing text, tables, documents, and multimedia; creating knowledge bases and search indexes; engineering RAG retrieval and citation systems; integrating LLMs and NLP models; managing orchestration, APIs, quality, cost, observability, reliability, and scalable production operations.
Top Skills:
APIsAsynchronous Task ProcessingCachingDistributed SystemsFull-Text SearchJavaKnowledge EngineeringLlmsMachine LearningMessage QueuesNlpPythonRagVector Search
Information Technology • Consulting
Leads the architecture, development, deployment, and governance of enterprise AI systems, including LLM applications, multimodal models, RAG, and multi-agent solutions. Drives prototyping through production delivery, establishes LLMOps practices such as CI/CD, observability, evaluation, and model versioning, and supports presales strategy. Collaborates with product and data teams, ensures security and privacy compliance, and mentors junior engineers.
Top Skills:
Aws SagemakerAzure MlCi/CdGcp Vertex AiHugging FaceLangchainLarge Language Models (Llms)LlmopsModel ObservabilityModel VersioningMulti-Agent SystemsPythonPyTorchRetrieval-Augmented Generation (Rag)TensorFlow
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
