Cloudflare starts blocking agents by default on September 15. I found out by accident.
This story is from 2026-09-06. It is preserved in the archive; the latest stories are on the live feed.
Nobody in scraping is talking about this and it lands in ten days. On September 15 Cloudflare flips a default. Every bot that hits a site behind them now gets sorted into one of three buckets. Search, agent, training. Search stays allowed. Agent and training get blocked by default on any page that…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-06 12:08 · DEV Community — AI
Cloudflare starts blocking agents by default on September 15. I found out by accident.