How an innocent OS upgrade triggered a cascade of issues and forced us into tracing Linux networking internals.
HTTP Analytics for 6M requests per second using ClickHouse
One of our large scale data infrastructure challenges here at Cloudflare is around providing HTTP traffic analytics to our customers. HTTP Analytics is available to all our customers via two options:
Squeezing the firehose: getting the most from Kafka compression
How Cloudflare was able to save hundreds of gigabits of network bandwidth and terabytes of storage from Kafka.
Scaling out PostgreSQL for CloudFlare Analytics using CitusDB
When I joined CloudFlare about 18 months ago, we had just started to build out our new Data Platform. At that point, the log processing and analytics pipeline built in the early days of the company had reached its limits.