Replay Cassettes Separate Harness Drift from Model Drift
This story is from 2026-10-20. It is preserved in the archive; the latest stories are on the live feed.
A prompt suite has three moving parts — prompt text, the grader, and the model snapshot — and a single pass-rate number moves whenever any one of them changes. Replay cassettes remove that ambiguity by freezing model output on disk and letting you re-run only the parts you actually edited. The rule…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-20 10:18 · DEV Community — AI
Replay Cassettes Separate Harness Drift from Model Drift