The Changing Geometry of Grammar: Dimensionality and Neighborhood Reorganization across Transformer Layers
This story is from 2026-08-27. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2608.25166v1 Announce Type: new Abstract: Transformer representations describe trajectories through high-dimensional vector spaces, which are shaped dynamically as tokens incorporate relational context across layers. Such data tend to concentrate on lower-dimensional sub-manifolds, a form of…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-08-27 04:00 · arXiv cs.CL
The Changing Geometry of Grammar: Dimensionality and Neighborhood Reorganization across Transformer Layers