Your Classifier Scored Ninety Six Percent Because the Same Emails Were in Both Halves
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
We trained a small model to route support emails. Delivery. Billing. Damaged goods. Account changes. Forty thousand labelled emails. Shuffle them. Eighty percent to train, twenty percent to test. The test score was ninety six percent. We celebrated. We shipped it. In the first month it routed about…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-16 06:59 · DEV Community — Machine Learning
Your Classifier Scored Ninety Six Percent Because the Same Emails Were in Both Halves