cse-frog: a dissectable toy language model (Hebbian, no attention), with its failures documented[P]
I made a small sequence predictor meant to be opened up, like the frog in biology class: the point is not that it's strong, but that the whole pipeline (learn → score → probability → sample) is there and readable. - Learning: Hebbian edge strengthening between symbols, plus a memory of the last two…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-08 13:32 · r/learnmachinelearning
cse-frog: a dissectable toy language model (Hebbian, no attention), with its failures documented[P]