New Study Examines Geometry of Fourier Circuit in Modular-Addition Transformer
A new arXiv paper analyzes the local differential geometry of a Fourier-based modular-addition circuit in a one-layer transformer, finding nonconformal distortion and local orientation reversal in the circuit.
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-11-03 05:00 · arXiv cs.AI
Nonconformal Distortion and Local Orientation Reversal in the Fourier Circuit of a Modular-Addition Transformer