AINewsnow

How to check whether your site blocks ChatGPT, Claude and Perplexity

This story is from 2026-10-12. It is preserved in the archive; the latest stories are on the live feed.

Plenty of sites turn AI crawlers away without anyone having decided to. A security plugin, a CDN setting or a line copied into robots.txt years ago is enough. If an assistant cannot fetch your pages, it cannot quote them, and you will not hear about it. Here is how to check, in about ten minutes. T…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-12 14:50 · DEV Community — AI
    How to check whether your site blocks ChatGPT, Claude and Perplexity

More stories

  1. ChatGPT vs. Claude vs. Gemini for Data Science Work: Here's What I Found — KDnuggets
  2. Import Skills Into Web Ver. of ChatGPT/Claude/Gemini. Prompt DB + Queueing prompts w/ Multimodal Support — r/PromptEngineering
  3. We fed a 15-year mental health crisis into Gemini, ChatGPT, and Claude to get advice for our friend group. The results surprised us. — r/GeminiAI
  4. a16z's seventh Top 100 Consumer AI Apps list is out, ChatGPT still at No. 1 and Claude up to third — r/artificial
  5. Can Gemini create pdf, docx, Xls files? — r/GeminiAI
  6. Why I switched to Claude (hint: custom connectors/MCP) — r/ClaudeAI
  7. How do you catch it when an AI assistant is looping instead of making progress? — r/AI_Agents
  8. Anyone using Claude, Gemini and ChatGPT together with shared up-to-date project context? — r/artificial

Get the daily brief of stories like this at 6:30 every morning →