DoSA: Dots Sparse Attention
arXiv:2610.13990v1 Announce Type: new Abstract: Sparse attention visits few keys, yet finding them can still require scoring every key with every indexer head. We introduce DoSA (Dots Sparse Attention), a lossless method for making this computation conditional while preserving exact token selection…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-14 04:00 · arXiv cs.LG
DoSA: Dots Sparse Attention