Using Apache Kafka to process 1 trillion inter-service messages
July 19, 2022 2:00PM
We learnt a lot about Kafka on the way to 1 trillion messages, and built some interesting internal tools to ease adoption that will be explored in this blog post...
How we improved DNS record build speed by more than 4,000x
May 25, 2022 1:59PM
DNS Kafka Speed & Reliability PGQ Product NewsHow we redesigned our DNS pipeline to significantly improve DNS propagation speed across all zones....
Getting to the Core: Benchmarking Cloudflare’s Latest Server Hardware
November 20, 2020 12:00PM
Hardware Genx Kafka Kubernetes ClickHouseA refresh of the hardware that Cloudflare uses to run analytics provided big efficiency improvements....
Tracing System CPU on Debian Stretch
May 13, 2018 5:00PM
Speed & Reliability Kafka eBPF LinuxHow an innocent OS upgrade triggered a cascade of issues and forced us into tracing Linux networking internals....
HTTP Analytics for 6M requests per second using ClickHouse
March 06, 2018 10:13PM
Analytics Data Speed & Reliability Kafka Cap'n ProtoOne of our large scale data infrastructure challenges here at Cloudflare is around providing HTTP traffic analytics to our customers. HTTP Analytics is available to all our customers via two options:...
More Posts
March 05, 2018 4:17PM
Squeezing the firehose: getting the most from Kafka compression
How Cloudflare was able to save hundreds of gigabits of network bandwidth and terabytes of storage from Kafka....
-
By