The reversal curse, watched layer by layer [RTRM, now on GitHub]
Quick background for anyone who missed it: Berglund et al. (2023) showed that language models suffer a "reversal curse." Train a model on "Tom Cruise's mother is Mary Lee Pfeiffer" and it can recite that fine — but ask "Who is Mary Lee Pfeiffer's son?" and it blanks. The fact got stored in one dire…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-12 10:22 · r/learnmachinelearning
The reversal curse, watched layer by layer [RTRM, now on GitHub]