Nonconformal Distortion and Local Orientation Reversal in the Fourier Circuit of a Modular-Addition Transformer
arXiv:2611.00414v1 Announce Type: new Abstract: We study the local differential geometry of a Fourier-based modular-addition circuit in a one-layer transformer whose algorithm has previously been reverse-engineered. For each of the five key Fourier frequencies, we restrict the model's multilayer pe…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-11-03 05:00 · arXiv cs.AI
Nonconformal Distortion and Local Orientation Reversal in the Fourier Circuit of a Modular-Addition Transformer