Design, build, automate, monitor, and optimize scalable AI/ML infrastructure on Microsoft Azure. Configure GPU-accelerated compute, Kubernetes, storage, networking, security, CI/CD, model deployment, observability, and MLOps systems. Develop infrastructure-as-code and automation, troubleshoot production workloads, optimize cost and performance, and collaborate with data scientists, ML engineers, and architects to integrate AI models into enterprise platforms.
Project Role : AI Infrastructure Architect
Project Role Description : Architect and build custom Artificial Intelligence (AI) infrastructure/hardware solutions. Optimize AI infrastructure/hardware performance, power consumption, cost and scalability of computational stack. Advise on AI infrastructure technology and vendor evaluation, selection and full stack integration.
Must have skills : Microsoft Azure Data Services
Good to have skills : AI Agents & Workflow Integration
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Role Summary / Description
AI Powered Tech Talent
As a hands-on Engineer in AI Infrastructure Architecture, you will design, build, automate, monitor and optimize AI/ML infrastructure on Microsoft Azure for reliable, scalable and cost-effective model development and production workloads. you will work on moderately complex infrastructure components under guidance from senior architects and engineers, contributing to GPU/accelerated compute environments, model deployment pipelines, observability, security and operational reliability for AI-driven business solutions.
Key Responsibilities
Write, review and debug code, scripts and infrastructure-as-code for Azure AI infrastructure, automation, monitoring and deployment tooling.
Configure and provision Azure compute resources for AI/ML workloads, including Azure VMs, Azure Kubernetes Service, Azure Machine Learning compute, Azure Storage and supporting networking/security services.
Support deployment automation and CI/CD pipelines for AI systems, models and applications using tools such as Git, Bicep/ARM/Terraform, Azure DevOps/GitHub Actions, Docker, Kubernetes and workflow orchestration tooling.
Deploy and operate AI services, model-serving components and data pipelines while applying reliability, security, cost-efficiency and scalability practices.
Monitor infrastructure and model-serving health using Azure Monitor, Log Analytics and related observability tools troubleshoot issues across compute, storage, networking, containers and application layers.
Collaborate with data scientists, ML engineers, platform engineers and architects to integrate AI models into enterprise systems while meeting compliance and operational requirements.
Document reusable patterns, configuration standards and runbooks for Azure-based AI infrastructure.
Required Qualifications
Bachelor's degree in Computer Science, Computer Engineering, Information Technology or a related engineering field.
Minimum 2 years of experience coding, building, monitoring or troubleshooting AI/ML infrastructure, data platforms, model deployment pipelines or cloud/platform engineering solutions.
Strong understanding of AI/ML concepts and the compute, storage, networking, security and deployment foundations required to run AI workloads.
Minimum 2 years of proficiency in programming or scripting languages such as Python, Java, C++, Bash or PowerShell.
Experience with CI/CD, infrastructure-as-code, containers, Kubernetes, workflow orchestration and operational monitoring tools.
Strong problem-solving ability, communication skills and collaboration mindset in a fast-paced engineering environment.
Required Skills/ Experience
Hands-on experience with Azure services relevant to AI infrastructure such as Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure Virtual Network, Azure Monitor, Log Analytics and Azure DevOps/GitHub Actions.
Experience designing or operating GPU/accelerated compute, distributed training setups, containerized deployments and model-serving workloads.
Working knowledge of Bicep/ARM/Terraform, Docker, Kubernetes, CI/CD pipelines and observability practices.
Ability to optimize infrastructure for performance, reliability, scalability, cost and security.
Understanding of MLOps patterns including experiment tracking, model registry, model deployment, monitoring and rollback approaches.
Good to Have Skills
Azure certification such as Azure Administrator, Azure Developer, Azure Solutions Architect, Azure AI Engineer or Azure Data Engineer.
Exposure to industry use cases in BFSI, healthcare, retail/e-commerce, telecom, manufacturing or public sector where AI infrastructure must meet compliance, reliability and data-governance expectations.
Familiarity with large language model infrastructure, vector databases, retrieval pipelines, GPU scheduling or model optimization techniques.
Knowledge of security controls, FinOps practices, incident management and production support processes for enterprise AI platforms.
15 years full time education
Project Role Description : Architect and build custom Artificial Intelligence (AI) infrastructure/hardware solutions. Optimize AI infrastructure/hardware performance, power consumption, cost and scalability of computational stack. Advise on AI infrastructure technology and vendor evaluation, selection and full stack integration.
Must have skills : Microsoft Azure Data Services
Good to have skills : AI Agents & Workflow Integration
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Role Summary / Description
AI Powered Tech Talent
As a hands-on Engineer in AI Infrastructure Architecture, you will design, build, automate, monitor and optimize AI/ML infrastructure on Microsoft Azure for reliable, scalable and cost-effective model development and production workloads. you will work on moderately complex infrastructure components under guidance from senior architects and engineers, contributing to GPU/accelerated compute environments, model deployment pipelines, observability, security and operational reliability for AI-driven business solutions.
Key Responsibilities
Write, review and debug code, scripts and infrastructure-as-code for Azure AI infrastructure, automation, monitoring and deployment tooling.
Configure and provision Azure compute resources for AI/ML workloads, including Azure VMs, Azure Kubernetes Service, Azure Machine Learning compute, Azure Storage and supporting networking/security services.
Support deployment automation and CI/CD pipelines for AI systems, models and applications using tools such as Git, Bicep/ARM/Terraform, Azure DevOps/GitHub Actions, Docker, Kubernetes and workflow orchestration tooling.
Deploy and operate AI services, model-serving components and data pipelines while applying reliability, security, cost-efficiency and scalability practices.
Monitor infrastructure and model-serving health using Azure Monitor, Log Analytics and related observability tools troubleshoot issues across compute, storage, networking, containers and application layers.
Collaborate with data scientists, ML engineers, platform engineers and architects to integrate AI models into enterprise systems while meeting compliance and operational requirements.
Document reusable patterns, configuration standards and runbooks for Azure-based AI infrastructure.
Required Qualifications
Bachelor's degree in Computer Science, Computer Engineering, Information Technology or a related engineering field.
Minimum 2 years of experience coding, building, monitoring or troubleshooting AI/ML infrastructure, data platforms, model deployment pipelines or cloud/platform engineering solutions.
Strong understanding of AI/ML concepts and the compute, storage, networking, security and deployment foundations required to run AI workloads.
Minimum 2 years of proficiency in programming or scripting languages such as Python, Java, C++, Bash or PowerShell.
Experience with CI/CD, infrastructure-as-code, containers, Kubernetes, workflow orchestration and operational monitoring tools.
Strong problem-solving ability, communication skills and collaboration mindset in a fast-paced engineering environment.
Required Skills/ Experience
Hands-on experience with Azure services relevant to AI infrastructure such as Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure Virtual Network, Azure Monitor, Log Analytics and Azure DevOps/GitHub Actions.
Experience designing or operating GPU/accelerated compute, distributed training setups, containerized deployments and model-serving workloads.
Working knowledge of Bicep/ARM/Terraform, Docker, Kubernetes, CI/CD pipelines and observability practices.
Ability to optimize infrastructure for performance, reliability, scalability, cost and security.
Understanding of MLOps patterns including experiment tracking, model registry, model deployment, monitoring and rollback approaches.
Good to Have Skills
Azure certification such as Azure Administrator, Azure Developer, Azure Solutions Architect, Azure AI Engineer or Azure Data Engineer.
Exposure to industry use cases in BFSI, healthcare, retail/e-commerce, telecom, manufacturing or public sector where AI infrastructure must meet compliance, reliability and data-governance expectations.
Familiarity with large language model infrastructure, vector databases, retrieval pipelines, GPU scheduling or model optimization techniques.
Knowledge of security controls, FinOps practices, incident management and production support processes for enterprise AI platforms.
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Accenture Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Information Technology
Designs and builds enterprise-grade GenAI and LLM infrastructure on Azure, including agents, RAG pipelines, orchestration, integrations, evaluation, observability, security, and governance components. Develops production-quality Python software, implements data ingestion and retrieval workflows, and optimizes performance, scalability, reliability, and cost. Collaborates with architects, data engineers, product owners, and security teams to deliver maintainable AI solutions and reusable engineering patterns.
Top Skills:
Api ManagementApplication InsightsAzure Ai FoundryAzure Ai SearchAzure FunctionsAzure Key VaultAzure MonitorAzure OpenaiCi/CdDefender For CloudDockerEvent GridFastapiFoundry Agent ServiceGitHaystackInfrastructure As CodeKubernetesLangchainLanggraphLlamaindexLogic AppsAzureMicrosoft Entra IdMicrosoft FabricMlflowPrompt FlowPythonRagSemantic KernelVector Databases
Information Technology
Designs and builds enterprise-grade AI infrastructure and LLM application components on Azure. Responsibilities include developing RAG pipelines, agents, orchestration, retrieval workflows, safety controls, APIs, integrations, monitoring, and evaluation systems. The role translates architecture into production-quality software, implements secure and scalable AI platforms, collaborates with technical and security stakeholders, and leads engineering practices including testing, CI/CD, observability, documentation, and governance.
Top Skills:
Agentic AiApi ManagementApplication InsightsAzure Ai SearchAzure FunctionsAzure Key VaultAzure MonitorAzure OpenaiCi/CdDockerEmbeddingsEvent GridFastapiFoundry Agent ServiceGenerative AiGitHaystackInfrastructure As CodeKubernetesLangchainLanggraphLlamaindexLlmsLogic AppsAzureMicrosoft Azure Ai FoundryMicrosoft Entra IdMicrosoft FabricMlflowPrompt FlowPythonRagSemantic KernelVector Databases
Information Technology
Lead enterprise AI architecture across generative AI, LLM applications, agentic systems, data, models, inference, security, governance, observability and FinOps. Define Azure AI target architectures, platform strategies, technology selections and transformation roadmaps. Guide domain architects and senior engineers while advising executives on AI investments, regulatory controls, responsible AI, enterprise integration, operational readiness and measurable business outcomes.
Top Skills:
Api ManagementApplication InsightsAzure Ai SearchAzure Defender For CloudAzure FunctionsAzure Key VaultAzure MonitorAzure OpenaiDockerEvent GridFastapiFoundry Agent ServiceGenerative AiHaystackKubernetesLangchainLanggraphLlamaindexLogic AppsAzureMicrosoft Azure Ai FoundryMicrosoft Entra IdMicrosoft FabricMlflowPrompt FlowSemantic Kernel
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
