AINewsnow

OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers

OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers The new control will allow publishers to apply their AI training preferences across multiple crawlers.

Read the full story at Techmeme ↗

Timeline · 1 report

  1. 2026-10-30 21:05 · Techmeme
    OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard that publishers can use to opt out of being scraped by AI across multiple crawlers

More stories

  1. Gemini 4 Carbon: our next frontier model — Google Gemini Blog
  2. The biggest names in AI are backing a new way to opt out of scraping — The Verge AI
  3. DailyAI Briefing: Google’s AI bill outruns its cash, plus 4 more — DailyAI
  4. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  5. US tech stocks fall after earnings fuel AI spending concerns — Financial Times AI
  6. I wrote a meta-prompt to answer “What should I ask the AI to do next?” Looking for critique. — r/PromptEngineering
  7. AI Security Agents Compared: Claude, Codex, Mantis, Cloudflare — MarkTechPost
  8. Is prompt engineering really a thing or is it just a bait to buy course/get contact info ? — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →