Local RAG on a mini PC: EmbeddingGemma 2, PDF Desk, and when to add a vector store
Local RAG doesn't require a GPU tower humming under your desk. On a mini PC you can assemble a working retrieval pipeline from two published pieces: EmbeddingGemma 2, an open 740M-parameter embedding model, and PDF Desk, a small Python/Streamlit app that answers questions about a PDF and points at…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-15 10:12 · DEV Community — AI
Local RAG on a mini PC: EmbeddingGemma 2, PDF Desk, and when to add a vector store