Goodfire identifies small neuron groups steering grammar and arithmetic in Llama 3.1 8B
Goodfire's unsupervised method found thousands of tiny neuron groups inside Llama-3.1-8B, often under ten neurons, that are causally necessary and sufficient for behaviors such as grammar and arithmetic.
Read the full story at AlphaSignal ↗
Timeline · 1 report
- 2026-11-17 17:24 · AlphaSignal
Goodfire Finds Tiny Neuron Teams Inside Llama 3.1 8B Steering Grammar