We checked 740 of the world's top websites for AI bots. Most that block GPTBot also block ChatGPT search
This story is from 2026-10-12. It is preserved in the archive; the latest stories are on the live feed.
Originally published on pagelens.io . Most advice about AI search starts with "check your robots.txt". I wanted to know what the biggest sites actually do, so I ran an AI visibility check on the top 1,500 domains of the Tranco list (list 4672X), a research ranking of the most visited domains, on Oc…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-12 08:27 · DEV Community — AI
We checked 740 of the world's top websites for AI bots. Most that block GPTBot also block ChatGPT search