An AI training crawler was 58% of my site's traffic. I charged it $0.001 a page and it left.
My database is on a free tier with 5 million reads a day, and it was sitting at 4.8 million. I couldn't figure out why, so I watched live traffic for 75 seconds. 52 of 89 requests (58%) came from one user agent: ElevenlabsCrawler/1.0 . ElevenLabs documents it as the crawler that collects content th…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-15 17:51 · DEV Community — AI
An AI training crawler was 58% of my site's traffic. I charged it $0.001 a page and it left.