Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization
arXiv:2610.12657v1 Announce Type: new Abstract: Efficient autoregressive generation is increasingly limited by the memory footprint of the key-value (KV) cache, which grows linearly with sequence length, batch size, and model depth. Existing approaches such as Multi-Query Attention (MQA), Grouped-Q…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-12 04:00 · arXiv cs.LG
Kronecker Product Attention: Memory-Efficient KV Compression via Structured Factorization