Some Tokens Behave like Magnets: Revealing Linguistic Organization in the Layers of Language Models
This story is from 2026-09-09. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.05743v1 Announce Type: new Abstract: We identify a special group of token vectors inside large language models (LLMs), which we term magnetic vectors, that organize the surrounding tokens by either attracting or repelling them. Particularly, tokens pointing the same way as an attracting…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-09-09 04:00 · arXiv cs.CL
Some Tokens Behave like Magnets: Revealing Linguistic Organization in the Layers of Language Models