Manage, deploy, and optimize Apache Kafka clusters and large-scale streaming platforms. Monitor performance, troubleshoot production incidents, automate operational tasks, implement capacity planning and disaster recovery, ensure security and compliance, create runbooks, and participate in on-call incident response to maintain highly available, scalable platform infrastructure.
𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀
𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟭𝟮𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟮𝟴𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟭𝟮-𝟮𝟴 𝗟𝗣𝗔)
Experience: 6+ yrs
Location: Hyderabad, Bengaluru, Pune, Chennai, Tamil Nadu, India, Mumbai, Maharashtra, India
Job Type: Full-time
We are seeking an experienced Kafka Platform Engineer with strong expertise in distributed systems, large-scale messaging platforms, and production operations. This role is ideal for professionals who are passionate about building, maintaining, and optimizing highly available streaming infrastructure while ensuring reliability, scalability, and operational excellence across enterprise environments.
As a Kafka Platform Engineer, you will be responsible for managing mission-critical messaging platforms, improving platform performance, automating operational processes, and supporting production environments. You will collaborate with infrastructure, application, DevOps, and engineering teams to deliver resilient streaming solutions, troubleshoot complex production issues, and continuously enhance platform reliability through automation, monitoring, and best practices.
RequirementsKey Responsibilities
- Design, deploy, manage, and optimize Apache Kafka clusters and large-scale messaging or streaming platforms.
- Monitor platform health, system performance, and resource utilization using modern monitoring, logging, and alerting tools.
- Troubleshoot production incidents, identify root causes, and implement long-term solutions to improve system stability.
- Automate operational tasks, deployments, and maintenance activities using scripting and infrastructure automation techniques.
- Collaborate with application and infrastructure teams to support messaging architecture, integrations, and production workloads.
- Implement performance tuning, capacity planning, and scalability improvements for distributed systems.
- Maintain high availability, fault tolerance, and disaster recovery strategies for messaging infrastructure.
- Ensure platform security, system compliance, and operational best practices across production environments.
- Develop operational documentation, runbooks, and knowledge-sharing resources to improve support efficiency.
- Participate in on-call support, incident response, and continuous improvement initiatives to maintain service reliability.
- 6+ years of experience managing distributed systems, production infrastructure, or platform engineering environments.
- Strong hands-on experience with Apache Kafka or large-scale messaging and event streaming platforms.
- Deep understanding of distributed systems architecture, scalability, fault tolerance, and production operations.
- Experience with monitoring, logging, alerting, and observability tools for enterprise infrastructure.
- Proficiency in at least one scripting or programming language such as Python, Bash, or Java.
- Strong knowledge of Linux system administration, networking fundamentals, and troubleshooting methodologies.
- Experience automating operational workflows and improving platform reliability through scripting and infrastructure automation.
- Excellent analytical, debugging, and problem-solving skills with a proactive operational mindset.
- Strong communication and collaboration skills with the ability to work effectively across cross-functional engineering teams.
- Passion for building reliable, secure, and highly available platform infrastructure while continuously improving operational excellence.
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Operate and improve production multi-cloud platform services: deploy and maintain Kubernetes clusters, build CI/CD and GitOps pipelines, create self-service control planes, manage capacity and DR, implement observability and security, own on-call/incidents, automate repetitive work, and enable consuming engineering teams.
Top Skills:
AIArgo WorkflowsArgocdCrossplaneFluxGithub ActionsGitopsGoGrafanaIstioJaegerJenkinsKubernetesLinkerdOpentelemetryPrometheusPulumiTektonTemporalTerraform
.jpeg){kind=icon}
Cloud • Enterprise Web • Hardware • Information Technology • Internet of Things • Robotics • Semiconductor
Build, automate, and operate a global cloud platform: develop automation in Go/Python, manage large-scale EKS clusters (Karpenter), author Terraform and Helm IaC, lead incident response and post-mortems, define SLIs/SLOs, implement observability (Datadog/Prometheus/Grafana) and PagerDuty on-call, and develop secure self-service tools to meet SOC2. Night-shift role based in Ahmedabad, India.
Top Skills:
Amazon EksAWSCachingDatadogDynamoDBGoGrafanaHelmKafkaKarpenterKubernetesMskPagerdutyPrometheusPythonTerraform
Information Technology
Design and maintain CI/CD pipelines, automate cloud deployments with Terraform and Python, manage AKS Kubernetes and containers, implement monitoring/alerting, perform incident response and RCA, and collaborate with teams for reliable deployments.
Top Skills:
AksAWSAzureAzure DevopsDockerGCPGitGrafanaKubernetesPrometheusPythonTerraform
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
