Google, Microsoft, Anthropic and OpenAI to support new AI crawling opt-out standard
Google, Microsoft, Anthropic and OpenAI announced plans to support an upcoming website crawling standard that will let website operators block AI systems from accessing their content.
Read the full story at SiliconANGLE AI ↗
Timeline · 1 report
- 2026-10-31 02:00 · SiliconANGLE AI
Google, Anthropic and others to support new AI crawling opt-out standard
More stories
- OpenAI, Google, Microsoft and Anthropic to honor shared robots.txt opt-out for AI training — OpenAI News
- Major AI companies back new standard for publishers to opt out of scraping — The Verge AI
- Forward Deployed Engineer: the job AI borrowed from Palantir — DEV Community — AI
- Mistral releases weights for trillion-parameter 'Le Chonk' model — Mistral AI News
- US tech stocks fall as earnings misses deepen AI spending concerns — Financial Times AI
- What we got wrong building an MCP server for AI visibility data — DEV Community — AI
- Generative Engine Optimization (GEO): The Engineering Blueprint for Ranking Inside ChatGPT, Perplexity, and Claude in 2026 — DEV Community — AI
- ChatGPT vs Gemini vs Claude: Pick by the Job, Not by the Hype — DEV Community — AI
Get the daily brief of stories like this at 6:30 every morning →