My Benchmark Finished in 0.2 Minutes. The Number Was a File Read.
TL;DR: a benchmark that finishes in 0.2 minutes did not run. Mine reprinted four-day-old numbers from a capture file committed to git, and I published them three times as a design trade-off. With the cache cleared, the same panel reads 19 → 32 → 38 across five code states — and six of those tasks c…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-14 11:33 · DEV Community — AI
My Benchmark Finished in 0.2 Minutes. The Number Was a File Read.