Lead the Data Pipeline team, managing system operations at scale, prioritizing tasks, and ensuring team cohesion in a distributed environment.
Cloudflare is looking for an Engineering Manager to lead the Data Pipeline team
Available Location : Lisbon, Portugal, London, UK
The Data Pipeline team builds the systems which collect customer event logs from all Cloudflare products. These event logs are delivered to hundreds of thousands of destinations (internal and external). The whole of Cloudflare, and many of our customers depend on the availability of this data.
The defining characteristic of the Data Pipeline team is scale. Cloudflare products generate hundreds of millions of event logs per second, which translate into data systems that process hundreds of GBs per second. The systems are under constant load. Every day brings new lessons (sometimes hard!) of scale.
Operating at scale means always working on the most important thing. As engineering manager of the Data Pipeline team, you have a passion for prioritization. When you, the team and the systems are asked to do more work than can be done, you'll need to choose what is important, and delay everything else.
You will be the "glue" of a team that is distributed across Europe and North America. You will communicate clearly and with empathy, and work towards creating a cohesive high-performance team. You will be responsible for all aspects of team life - building roadmaps, running meetings, hiring, and setting up engineers for success. Many of these activities will be done in close collaboration with our partners in the Product team.
The team predominantly uses Go to write programs that are deployed on bare metal and Kubernetes. Any prior experience in these technologies will make you well-suited for this role.
Examples of desirable skills, knowledge and experience
Bonus Points
Available Location : Lisbon, Portugal, London, UK
The Data Pipeline team builds the systems which collect customer event logs from all Cloudflare products. These event logs are delivered to hundreds of thousands of destinations (internal and external). The whole of Cloudflare, and many of our customers depend on the availability of this data.
The defining characteristic of the Data Pipeline team is scale. Cloudflare products generate hundreds of millions of event logs per second, which translate into data systems that process hundreds of GBs per second. The systems are under constant load. Every day brings new lessons (sometimes hard!) of scale.
Operating at scale means always working on the most important thing. As engineering manager of the Data Pipeline team, you have a passion for prioritization. When you, the team and the systems are asked to do more work than can be done, you'll need to choose what is important, and delay everything else.
You will be the "glue" of a team that is distributed across Europe and North America. You will communicate clearly and with empathy, and work towards creating a cohesive high-performance team. You will be responsible for all aspects of team life - building roadmaps, running meetings, hiring, and setting up engineers for success. Many of these activities will be done in close collaboration with our partners in the Product team.
The team predominantly uses Go to write programs that are deployed on bare metal and Kubernetes. Any prior experience in these technologies will make you well-suited for this role.
Examples of desirable skills, knowledge and experience
- Engineering leadership skills: leading, hiring and coaching.
- Strong technical foundation: large distributed system design and operations, being comfortable interacting deeply with data (SQL, Prometheus) about how your systems are operating.
- A self-directing nature, keen to take ownership of projects from start to finish.
- Experience coordinating projects across multiple teams.
Bonus Points
- Experience leading teams using any of the following: C++, Go, Rust, ClickHouse, Prometheus, Kubernetes, Salt.
- Experience leading distributed teams.
Top Skills
C++
Clickhouse
Go
Kubernetes
Prometheus
Rust
Salt
SQL
Similar Jobs at Cloudflare
Cloud • Information Technology • Security • Software • Cybersecurity
The Principal Compiler Engineer will enhance the V8 compiler for Cloudflare's Workers Runtime, focusing on performance and scalability improvements in a distributed environment.
Top Skills:
C++JavaScriptLinuxRustV8Webassembly
Cloud • Information Technology • Security • Software • Cybersecurity
Lead the EMEA Specialist Solutions Engineering team, driving technical sales strategies, optimizing processes, and fostering collaboration for customer solutions.
Top Skills:
Cloud InfrastructureCloudflare TechnologiesCybersecurityNetworkingSaaS
Cloud • Information Technology • Security • Software • Cybersecurity
As a Senior Named Solutions Engineer, you will collaborate with clients to solve complex technology challenges, advocating for technical solutions and managing projects while providing guidance on best practices.
Top Skills:
BashCloudflareDnsHTTPJavaScriptPythonTcpTlsUdp
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
