A Mesoscopic View of Transformer Weights Through Row and Column Scale Fields
This story is from 2026-09-30. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.35852v1 Announce Type: new Abstract: Pooled statistics of Transformer weights obscure how magnitude is distributed across functional channels, while individual weights are too numerous to compare directly. We study the mesoscopic level between them: row and column scale fields, the media…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-30 04:00 · arXiv cs.LG
A Mesoscopic View of Transformer Weights Through Row and Column Scale Fields