Saw crawl4ai and built a small MCP tool on top of it, so local models can read pages that don't fit in context
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
I came across [crawl4ai]( https://github.com/unclecode/crawl4ai ) a while back and it does the hard part — real browser, JS rendering, clean markdown out. What I still didn't have was a way to hand the result to a local model. The median page I measured is ~14.5k tokens; the biggest was 135k. That…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-04 05:23 · r/LocalLLM
Saw crawl4ai and built a small MCP tool on top of it, so local models can read pages that don't fit in context