Could inference as a frozen projection of learned organization provide a common mechanistic view of scaling and attention?
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
This is part of my own work on a mechanistic view of training, learning and inference, and one result I keep coming back to is this: nference may be better understood as a frozen, query-conditioned projection of functional organization already formed during training. By “frozen”, I mean that infere…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-08-21 13:08 · r/deeplearning
Could inference as a frozen projection of learned organization provide a common mechanistic view of scaling and attention?