My URL-to-Markdown fetcher taught me that 'main content' is a guess until you give it a selector
I built a URL-to-Markdown endpoint because I wanted to feed arbitrary web pages into agent context windows without stuffing in navbars, cookie banners, and 40 comment threads. The naive version — grab the DOM, strip obvious junk, convert — worked great on blog posts and terribly on everything else.…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-05 07:04 · DEV Community — AI
My URL-to-Markdown fetcher taught me that 'main content' is a guess until you give it a selector