Attention RAG
Hi people my friends and I are working on our take of RAG indexing. Our idea goes like that: Standard embedding-based RAG often compresses an entire text chunk into one vector. Our idea keeps multiple compact representations within each document, giving a query smaller, more specific parts to match…
Read the full story at r/MLQuestions ↗
Timeline · 1 report
- 2026-10-08 19:52 · r/MLQuestions
Attention RAG