Billions and billions (of logs): scaling AI Gateway with the Cloudflare Developer Platform
2024-10-24
How we scaled AI Gateway to handle and store billions of requests, using Cloudflare Workers, D1, Durable Objects, and R2....
Continue reading »
Cloudflare’s bigger, better, faster AI platform
2024-09-26
Whether you want the fastest inference at the edge, optimized AI workflows, or vector database-powered RAG, we’re excited to help you harness the full potential of AI and get started on building with Cloudflare....
AI Gateway is generally available: a unified interface for managing and scaling your generative AI workloads
2024-05-22
AI Gateway is an AI ops platform that provides speed, reliability, and observability for your AI applications. With a single line of code, you can unlock powerful features including rate limiting, custom caching, real-time logs, and aggregated analytics across multiple providers...
Mitigating a token-length side-channel attack in our AI products
2024-03-14
The Workers AI and AI Gateway team recently collaborated closely with security researchers at Ben Gurion University regarding a report submitted through our Public Bug Bounty program. Through this process, we discovered and fully patched a vulnerability affecting all LLM providers. Here’s the story...
Announcing AI Gateway: making AI applications more observable, reliable, and scalable
2023-09-27
AI Gateway helps developers have greater control and visibility in their AI apps, so that you can focus on building without worrying about observability, reliability, and scaling. AI Gateway handles the things that nearly all AI applications need...
MORE POSTS
May 15, 2023 1:00 PM
A complete suite of Zero Trust security tools to help get the most from AI
Secure your team’s usage of AI tools with Cloudflare One...
- By