Major AI companies back new standard for publishers to opt out of scraping
OpenAI, Google, Microsoft, and Anthropic say they will adopt a new standard allowing publishers to opt out of having their content scraped for AI.
Read the full story at The Verge AI ↗
Timeline · 1 report
- 2026-10-30 20:26 · The Verge AI
The biggest names in AI are backing a new way to opt out of scraping
More stories
- OpenAI, Google, Microsoft and Anthropic to honor shared robots.txt opt-out for AI training — OpenAI News
- Google, Microsoft, Anthropic and OpenAI to support new AI crawling opt-out standard — SiliconANGLE AI
- Forward Deployed Engineer: the job AI borrowed from Palantir — DEV Community — AI
- Mistral releases weights for trillion-parameter 'Le Chonk' model — Mistral AI News
- US tech stocks fall as earnings misses deepen AI spending concerns — Financial Times AI
- What we got wrong building an MCP server for AI visibility data — DEV Community — AI
- Generative Engine Optimization (GEO): The Engineering Blueprint for Ranking Inside ChatGPT, Perplexity, and Claude in 2026 — DEV Community — AI
- ChatGPT vs Gemini vs Claude: Pick by the Job, Not by the Hype — DEV Community — AI
Get the daily brief of stories like this at 6:30 every morning →