Subscribe to receive notifications of new posts:

Why we're rethinking cache for the AI era

2026-04-02

ResearchCache

The explosion of AI-bot traffic, representing over 10 billion requests per week, has opened up new challenges and opportunities for cache design. We look at some of the ways AI bot traffic differs from humans, how this impacts CDN cache, and some early ideas for how Cloudflare is designing systems to improve the AI and human experience....

Launching Cloudflare’s Gen 13 servers: trading cache for cores for 2x edge compute performance

2026-03-23

HardwarePerformanceInfrastructureRustAMDEngineering

Cloudflare’s Gen 13 servers double our compute throughput by rethinking the balance between cache and cores. Moving to high-core-count AMD EPYC ™ Turin CPUs, we traded large L3 cache for raw compute density. By running our new Rust-based FL2 stack, we completely mitigated the latency penalty to unlock twice the performance....