Is the model actually getting dumber, or are we just reading tea leaves from single samples?
Disclosure: I'm involved in building Folkbench, which I mention near the end of this post. I've been chewing on a question that's been discussed to death but never really settled: when we say a model "got dumber" or "got nerfed," how much of that is real, and how much is just the illusion of a sing…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-05 13:10 · DEV Community — Machine Learning
Is the model actually getting dumber, or are we just reading tea leaves from single samples?