2 weeks pf hyperparameter tuning and the problem was in my train/test split
This story is from 2026-09-17. It is preserved in the archive; the latest stories are on the live feed.
Support ticket classifier at work, seven categories, a few hundred thousand tickets. Validation accuracy was sitting around 94 and then it would go live and get maybe 70 on real traffic. So I did what I think most people would do and started blaming the model. Tried a larger base model, then a smal…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-09-17 13:07 · r/learnmachinelearning
2 weeks pf hyperparameter tuning and the problem was in my train/test split