How many small business websites block AI crawlers?
Short answer: about 1 in 7 small-business websites aren't fully open to AI crawlers, and most owners didn't choose that. Only about 3% block AI crawlers on purpose in robots.txt. This is a cross-post of Preferly's October 2026 study . The method, charts and category totals live there, and the aggre…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-19 07:05 · DEV Community — AI
How many small business websites block AI crawlers?