Meta Llama 3.1 now available on Workers AI
2024-07-23
Cloudflare is excited to be a launch partner with Meta to introduce Workers AI support for Llama 3.1...
Embedded function calling in Workers AI: easier, smarter, faster
2024-06-27
Introducing a new way to do function calling in Workers AI by running function code alongside your inference. Plus, a new @cloudflare/ai-utils package to make getting started as simple as possible...
AI Gateway is generally available: a unified interface for managing and scaling your generative AI workloads
2024-05-22
AI Gateway is an AI ops platform that provides speed, reliability, and observability for your AI applications. With a single line of code, you can unlock powerful features including rate limiting, custom caching, real-time logs, and aggregated analytics across multiple providers...
Meta Llama 3 available on Cloudflare Workers AI
2024-04-18
We are thrilled to give developers around the world the ability to build AI applications with Meta Llama 3 using Workers AI. We are proud to be a launch partner with Meta for their newest 8B Llama 3 model...
Leveling up Workers AI: general availability and more new capabilities
2024-04-02
Today, we’re excited to make a series of announcements, including Workers AI, Cloudflare’s inference platform becoming GA and support for fine-tuned models with LoRAs and one-click deploys from HuggingFace. Cloudflare Workers now supports the Python programming language, and more...
Running fine-tuned models on Workers AI with LoRAs
2024-04-02
Workers AI now supports fine-tuned models using LoRAs. But what is a LoRA and how does it work? In this post, we dive into fine-tuning, LoRAs and even some math to share the details of how it all works under the hood...
Mitigating a token-length side-channel attack in our AI products
2024-03-14
The Workers AI and AI Gateway team recently collaborated closely with security researchers at Ben Gurion University regarding a report submitted through our Public Bug Bounty program. Through this process, we discovered and fully patched a vulnerability affecting all LLM providers. Here’s the story...
Unlocking new use cases with 17 new models in Workers AI, including new LLMs, image generation models, and more
2024-02-28
On February 6th, 2024 we announced eight new models that we added to our catalog for text generation, classification, and code generation use cases. Today, we’re back with seventeen (17!) more models, focused on enabling new types of tasks and use cases with Workers AI...
Adding new LLMs, text classification and code generation models to the Workers AI catalog
2024-02-06
Workers AI is now bigger and better with 8 new models and improved model performance...
Announcing AI Gateway: making AI applications more observable, reliable, and scalable
2023-09-27
AI Gateway helps developers have greater control and visibility in their AI apps, so that you can focus on building without worrying about observability, reliability, and scaling. AI Gateway handles the things that nearly all AI applications need...
