AINewsnow

Google, OpenAI, Microsoft and Anthropic to honor shared robots.txt AI-training opt-out

The four AI companies announced they plan to honor a shared robots.txt signal that lets websites opt out of having their content used for AI training.

Read the full story at r/OpenAI ↗

Timeline · 17 reports

  1. 2026-11-02 22:11 · DEV Community — AI
    AI Daily Digest November 3, 2026: OpenAI Wires Agents into ServiceNow, Australia Books a 40,000-GPU AI Factory
  2. 2026-11-02 21:15 · DEV Community — AI
    Google, Microsoft, OpenAI and Anthropic Back a Shared AI Training Opt-Out Signal
  3. 2026-11-02 06:45 · DEV Community — Machine Learning
    Weekly AI Digest · November 2, 2026
  4. 2026-11-02 06:00 · DEV Community — AI
    Google, OpenAI, Microsoft and Anthropic plan to honor shared AI-training opt-out
  5. 2026-11-01 22:15 · DEV Community — AI
    AI Daily Digest November 2, 2026: Four AI Giants Back One robots.txt Token, ChatGPT and Codex Merge Quotas, Apple Puts Qwen Inside Siri
  6. 2026-11-01 16:44 · r/OpenAI
    OpenAI will honor a shared robots.txt signal so websites can opt out of AI training
  7. 2026-11-01 10:15 · DEV Community — AI
    Google, OpenAI and Microsoft Move Toward a Shared AI Training Control
  8. 2026-11-01 02:20 · DEV Community — AI
    One robots.txt Line Will Opt Your Site Out of AI Training at Google, OpenAI, Anthropic and Microsoft
  9. 2026-10-31 22:12 · DEV Community — AI
    AI Daily Digest November 1, 2026: Google Folds Jules into Antigravity, Claude Ultra Drops the 5-Hour Clock, an Agent Breaks into Chainalysis
  10. 2026-10-31 14:17 · DEV Community — AI
    Check robots.txt before your AI agent fetches a page: an 80-line RFC 9309 parser in Node
  11. 2026-10-31 13:09 · DEV Community — AI
    One robots.txt Rule to Opt Out of AI Training: What Developers Need to Know (2027)
  12. 2026-10-31 12:24 · The Next Web
    Google, Microsoft, OpenAI and Anthropic back one AI training opt-out
  13. 2026-10-31 11:30 · Unite.AI
    Google Plans Support for Shared Robots.txt AI Training Control
  14. 2026-10-31 06:39 · DEV Community — AI
    Google plans one robots.txt token for AI training opt-outs
  15. 2026-10-31 04:33 · DEV Community — AI
    One robots.txt Line That Speaks to Every AI Lab: Implementing the Shared Training Opt-Out
  16. 2026-10-31 03:47 · DEV Community — AI
    OpenAI, Google, Microsoft and Anthropic to support a unified AI training opt-out token in robots.txt
  17. 2026-10-31 01:19 · DEV Community — AI
    One robots.txt Line to Say No to AI Training: What OpenAI, Google, Microsoft and Anthropic Just Agreed

More stories

  1. How does the Zoho Analytics MCP server work? Close to 20 tools, delete rows included, and a live gate test — DEV Community — AI
  2. Can ChatGPT Read Your Website? An AI Search Readiness Checklist (2026) — DEV Community — AI
  3. I like Gemini's stupidity. — r/GeminiAI
  4. I got tired of AI writing 500 lines of C# boilerplate, so I built a language that forces it to generate strict architecture — DEV Community — AI
  5. ChatGPT, Claude, Gemini down: What we know about the AI outages (updated) — Mashable AI
  6. What we got wrong building an MCP server for AI visibility data — DEV Community — AI
  7. Is ChatGPT or Claude better at helping you cheat? Social media found an answer in the most hilarious way — Fast Company AI
  8. I moved my MCP servers from Claude to Codex. Here's the cheat sheet — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →