My benchmark scored GPT-5.4 mini 1.00 by silently skipping the 3 questions it failed
This is a submission for the Kaggle Benchmarking Challenge GPT-5.4 mini got a perfect 1.00 on my benchmark. Then, in a separate repeats notebook, I asked it the same three questions five times each with the cache off, and it failed all 15. The model didn't change. My benchmark had four bugs. Two ma…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-09 08:48 · DEV Community — Machine Learning
My benchmark scored GPT-5.4 mini 1.00 by silently skipping the 3 questions it failed