Three runs is not a sample size. It is a decision rule — and its error is exactly computable.
Grab any paper that compares two models, two agents, two prompts. Find the part where it says how many runs it did. It will say three, or five, or "we used 5 seeds". Then find the sentence that says what error that number buys. It will not be there. That is not carelessness. It is a missing instrum…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-13 04:27 · DEV Community — Machine Learning
Three runs is not a sample size. It is a decision rule — and its error is exactly computable.