Running LLMs across Cloudflare’s network requires us to be smarter and more efficient about GPU memory bandwidth. That’s why we developed Unweight, a lossless inference-time compression system that achieves up to a 22% model footprint reduction, so that we can deliver faster and cheaper inference than ever before.
Foundations is a foundational Rust library, designed to help scale programs for distributed, production-grade systems
In this blog post, we are proud to introduce Oxy - our modern proxy framework, developed using the Rust programming language
The second blog post in the series on HTML rewriters picks up the story in 2017 after the launch of the Cloudflare edge compute platform Cloudflare Workers. It became clear that the developers using workers wanted the same HTML rewriting capabilities that we used internally,
Rocket Loader is in the news again. One of Cloudflare's earliest web performance products has been re-engineered for contemporary browsers and Web standards. It controls the load and execution of your JavaScript, ensuring useful, meaningful page content is unblocked and displayed sooner.
