The Cloudflare Blog

Subscribe to receive notifications of new posts:

security.txt

Robotcop: enforcing your robots.txt policies and stopping bots before they reach your website

2024-12-10

Today, the AI Audit dashboard gets an upgrade: you can now quickly see which AI services are honoring your robots.txt policies and then automatically enforce the policies against those that aren’t. ...

Celso Martinho
Will Allen
Nelson Duarte

Robotcop: enforcing your robots.txt policies and stopping bots before they reach your website

Enhance your website's security with Cloudflare’s free security.txt generator

2024-10-06

Better Internet Security Posture Security Standards security.txt

Introducing Cloudflare’s free security.txt generator, empowering all users to easily create and manage their security.txt files. This feature enhances vulnerability disclosure processes, aligns with industry standards, and is integrated into the dashboard for seamless access. Strengthen your website's security today!...

Alexandra Moraru
Sam Khawasé