Spent months fighting to get a full RAG pipeline (BGE-M3 + reranker + TTS) running on a 4GB laptop GPU. Here's what broke.
started this as a personal project to read massive textbooks and web novels, and it turned into a war with hardware limits. my setup is a windows laptop with 16GB RAM and a 4GB RTX 3050. no cloud, no "just throw more vram at it." the stack is tauri (rust) shell, nodejs orchestrator, and a python si…
Read the full story at r/machinelearningnews ↗
Timeline · 1 report
- 2026-11-17 16:09 · r/machinelearningnews
Spent months fighting to get a full RAG pipeline (BGE-M3 + reranker + TTS) running on a 4GB laptop GPU. Here's what broke.