AINewsnow

OpenAI, Google, Microsoft and Anthropic to honor shared robots.txt opt-out for AI training

OpenAI announced on October 30, 2026 that it will honor a shared robots.txt signal letting websites express AI training preferences, with Google, Microsoft and Anthropic also adopting the standard.

Read the full story at OpenAI News ↗

Timeline · 4 reports

  1. 2026-10-31 01:19 · DEV Community — AI
    One robots.txt Line to Say No to AI Training: What OpenAI, Google, Microsoft and Anthropic Just Agreed
  2. 2026-10-30 21:05 · Techmeme
    OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers
  3. 2026-10-30 18:27 · Unite.AI
    OpenAI to Honor Shared Robots.txt Signal for AI Training Preferences
  4. 2026-10-30 09:30 · OpenAI News
    Making it easier for websites to express AI training preferences

More stories

  1. Google, Microsoft, Anthropic and OpenAI to support new AI crawling opt-out standard — SiliconANGLE AI
  2. Major AI companies back new standard for publishers to opt out of scraping — The Verge AI
  3. Forward Deployed Engineer: the job AI borrowed from Palantir — DEV Community — AI
  4. Mistral releases weights for trillion-parameter 'Le Chonk' model — Mistral AI News
  5. US tech stocks fall as earnings misses deepen AI spending concerns — Financial Times AI
  6. What we got wrong building an MCP server for AI visibility data — DEV Community — AI
  7. Generative Engine Optimization (GEO): The Engineering Blueprint for Ranking Inside ChatGPT, Perplexity, and Claude in 2026 — DEV Community — AI
  8. ChatGPT vs Gemini vs Claude: Pick by the Job, Not by the Hype — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →