Exact Finite Attention Responses From RoPE Derivatives
This story is from 2026-09-15. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.14127v1 Announce Type: new Abstract: We derive exact local responses for attention interventions, allowing candidate edits to be scored from a cached baseline and one backward pass. The starting point is the RoPE derivative $\partial_p z(p) = A z(p)$: its integral gives the finite positi…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-09-15 04:00 · arXiv stat.ML
Exact Finite Attention Responses From RoPE Derivatives