Building on three week old models looks like gambling. It's the strictest engineering I do
Orbyt went from first commit to launch in 32 days with 243,000 lines and 4,124 tests, then kept getting rebuilt on models that had shipped only weeks earlier. Published benchmarks measure yesterday's questions on everyone else's problems. My own eval suite, scored mechanically and run on every rele…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-13 14:00 · DEV Community — AI
Building on three week old models looks like gambling. It's the strictest engineering I do