Cloudflare Is Helping ChatGPT Find New Pages. 5 Things I'd Fix So Crawlers Don't Skip Mine
This story is from 2026-10-17. It is preserved in the archive; the latest stories are on the live feed.
On October 15, Cloudflare and OpenAI shared early results from a research pilot they started in July. Cloudflare passed signals from its network to OpenAI's search crawler, and according to Cloudflare's write-up , that helped OpenAI discover and index "hundreds of millions of new web pages" for Cha…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-17 11:30 · DEV Community — AI
Cloudflare Is Helping ChatGPT Find New Pages. 5 Things I'd Fix So Crawlers Don't Skip Mine