Nonconformal Distortion and Local Orientation Reversal in the Fourier Circuit of a Modular-Addition Transformer
This story is from 2026-11-04. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2611.00414v1 Announce Type: new Abstract: We study the local differential geometry of a Fourier-based modular-addition circuit in a one-layer transformer whose algorithm has previously been reverse-engineered. For each of the five key Fourier frequencies, we restrict the model's multilayer pe…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-11-04 05:00 · arXiv cs.AI
Nonconformal Distortion and Local Orientation Reversal in the Fourier Circuit of a Modular-Addition Transformer