I built a local memory engine that replaces vector DBs with SQLite and runs in <1.2GB VRAM
This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.
Every time I tried running local RAG on my own GPU, I ran into the same headache: vector databases eat too much RAM, using an 8B model just to parse text takes forever, and cosine search still hallucinates when the context isn't actually there. I’ve been building Hillock to see if I could do this w…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-01 09:10 · r/LocalLLM
I built a local memory engine that replaces vector DBs with SQLite and runs in <1.2GB VRAM