Why do benchmark results go up every release, always?
This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.
A lot of releases are clearly improvements, such as the initial fable release but for some the consensus seems to be that not much improved, or even in some cases the release was worse. Examples of this are Opus 5 (initial release) benching above Fable. Or GPT Sol 6.1 over Astra or 5.6. Is this jus…
Read the full story at r/artificial ↗
Timeline · 1 report
- 2026-10-01 13:17 · r/artificial
Why do benchmark results go up every release, always?