Stay discoverable in search while disallowing AI training

This story is from 2026-09-16. It is preserved in the archive; the latest stories are on the live feed.

Article URL: https://blog.cloudflare.com/accountable-mixed-use-ai-crawlers/ Comments URL: https://news.ycombinator.com/item?id=49721435 Points: 72 # Comments: 41

Read the full story at Hacker News Front Page ↗

Timeline · 1 report

2026-09-16 02:25 · Hacker News Front Page
Stay discoverable in search while disallowing AI training

More stories

Trump announces a new 'AI Force,' but says he will not 'stifle' AI — Business Insider AI
Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
Google's Gemini AI hacks three other companies during security test — Sky News Technology
Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
AI's role in building AI surging? Anthropic says Claude now leads 26% of its R&D — Mint AI
Microsoft exec called AI scraping the “largest theft of labor in human history” — Ars Technica AI
Meet the Data Agent in ChatGPT Work — OpenAI YouTube

Get the daily brief of stories like this at 6:30 every morning →