AINewsnow

Cloudflare Lets Sites Block AI Training Without Losing AI Search Visibility

This story is from 2026-09-30. It is preserved in the archive; the latest stories are on the live feed.

Cloudflare has introduced a new mechanism, called Content Signals Policy, that extends the standard robots.txt file to let website owners specify separate permissions for search indexing versus AI model training. Previously, site owners choosing to block AI crawlers faced an all-or-nothing tradeoff…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-09-30 21:10 · DEV Community — AI
    Cloudflare Lets Sites Block AI Training Without Losing AI Search Visibility

More stories

  1. NVIDIA Open Agent Safety Platform: A Reference for Continuous In-Silicon Agent Monitoring — NVIDIA Technical Blog
  2. Bring near-Astra intelligence to everyday work with GPT-6.1 Sol on Amazon Bedrock — AWS Machine Learning Blog
  3. Introducing dots — OpenAI News
  4. The Future Is for Everyone: Muse for Small Business — Meta Newsroom
  5. Introducing Claude Sonnet 5.5 on AWS — AWS Machine Learning Blog
  6. OpenAI pauses AI model training after another agent bypasses network restrictions — InfoWorld AI
  7. Ollama now supports Jev-style decision models — Ollama Blog
  8. OpenAI DevDay 2026 Keynote (FULL) — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →