Gemma 3 builds a linearly decodable spatial map from text, but its answers never read it [R]
Independent, preregistered study on Gemma 3 (12B/27B) with text-only layouts like "A is 3 north of B, C is 2 east of A". - Probes read every object's position, even ones that need two sentences combined (R² 0.74). - Erasing that map costs no more than erasing random directions. The answers never re…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-11-12 22:29 · r/MachineLearning
Gemma 3 builds a linearly decodable spatial map from text, but its answers never read it [R]