The Mask Is Not the Model: We Audited Eight Released Models for Causal Leakage, and Two Failed
This story is from 2026-08-25. It is preserved in the archive; the latest stories are on the live feed.
The Mask Is Not the Model: We Audited Eight Released Models for Causal Leakage, and Two Failed An autoregressive model is only meaningful if position t depends on positions ≤ t and nothing else. Almost nobody checks. We built a check that fits on one page, ran it on eight public checkpoints, and fo…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-08-25 03:33 · DEV Community — Machine Learning
The Mask Is Not the Model: We Audited Eight Released Models for Causal Leakage, and Two Failed