I got a RAG app running on a 512 MB free server. The trick was not running the embedding model at all.
Most "build a RAG app" tutorials work fine in a notebook. Then you try to put one online on a free host, and it falls over. I wanted a document Q&A app that answers from my own files, cites its sources, refuses when the answer isn't there, and runs entirely on free tiers with no credit card . Here'…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-14 19:58 · DEV Community — AI
I got a RAG app running on a 512 MB free server. The trick was not running the embedding model at all.