Every demo run of my eval harness scores 82/100. That's the point.
I pasted a deliberately useless agent trajectory into my eval harness and it handed me 82/100 on quality anyway. That was demo mode, and I knew it — demo mode returns the same fixed sample numbers for any trajectory you paste in, which is exactly what a demo should do. But the number still made me…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-03 01:55 · DEV Community — AI
Every demo run of my eval harness scores 82/100. That's the point.