FourierQK: Filter Shape, Admissibility and the Leakage-Coverage Law
arXiv:2610.00009v1 Announce Type: new Abstract: Frequency-collapse attention [Zeris, 2026e] achieves large gains over standard dot-product attention by replacing the Q/K dot product with a bandpass-filtered inner product at a learned frequency. A natural follow-up question is: which filter shape wo…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-02 04:00 · arXiv cs.LG
FourierQK: Filter Shape, Admissibility and the Leakage-Coverage Law