Can an ML model be “correct” during testing but already be failing in production?
Imagine a model achieves 95% accuracy during testing and passes all validation checks. After deployment, the accuracy initially looks fine, but the model starts making poor predictions for a specific group of users or a new type of input. The overall accuracy may still remain around 94–95%, so noth…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-10-07 18:08 · r/learnmachinelearning
Can an ML model be “correct” during testing but already be failing in production?