Google, OpenAI, Microsoft and Anthropic to honor shared robots.txt AI-training opt-out
On October 31, 2026, Google, OpenAI, Microsoft and Anthropic announced they plan to honor a single shared robots.txt signal letting websites opt out of AI training.
Read the full story at Techmeme ↗
Timeline · 16 reports
- 2026-11-02 06:45 · DEV Community — Machine Learning
Weekly AI Digest · November 2, 2026 - 2026-11-02 06:00 · DEV Community — AI
Google, OpenAI, Microsoft and Anthropic plan to honor shared AI-training opt-out - 2026-11-01 22:15 · DEV Community — AI
AI Daily Digest November 2, 2026: Four AI Giants Back One robots.txt Token, ChatGPT and Codex Merge Quotas, Apple Puts Qwen Inside Siri - 2026-11-01 16:44 · r/OpenAI
OpenAI will honor a shared robots.txt signal so websites can opt out of AI training - 2026-11-01 10:15 · DEV Community — AI
Google, OpenAI and Microsoft Move Toward a Shared AI Training Control - 2026-11-01 02:20 · DEV Community — AI
One robots.txt Line Will Opt Your Site Out of AI Training at Google, OpenAI, Anthropic and Microsoft - 2026-10-31 22:12 · DEV Community — AI
AI Daily Digest November 1, 2026: Google Folds Jules into Antigravity, Claude Ultra Drops the 5-Hour Clock, an Agent Breaks into Chainalysis - 2026-10-31 14:17 · DEV Community — AI
Check robots.txt before your AI agent fetches a page: an 80-line RFC 9309 parser in Node - 2026-10-31 13:09 · DEV Community — AI
One robots.txt Rule to Opt Out of AI Training: What Developers Need to Know (2027) - 2026-10-31 12:24 · The Next Web
Google, Microsoft, OpenAI and Anthropic back one AI training opt-out - 2026-10-31 11:30 · Unite.AI
Google Plans Support for Shared Robots.txt AI Training Control - 2026-10-31 06:39 · DEV Community — AI
Google plans one robots.txt token for AI training opt-outs - 2026-10-31 04:33 · DEV Community — AI
One robots.txt Line That Speaks to Every AI Lab: Implementing the Shared Training Opt-Out - 2026-10-31 03:47 · DEV Community — AI
OpenAI, Google, Microsoft and Anthropic to support a unified AI training opt-out token in robots.txt - 2026-10-31 01:19 · DEV Community — AI
One robots.txt Line to Say No to AI Training: What OpenAI, Google, Microsoft and Anthropic Just Agreed - 2026-10-30 21:05 · Techmeme
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers