SQuAD's answer normalizer can mark a wrong answer correct: three verified hazards
The exact-match and F1 scores in most question-answering and many open-ended LLM evals run every answer through one tiny, famous function first: SQuAD's normalize_answer . It lowercases, strips punctuation, drops the articles a / an / the , and collapses whitespace. It's pure standard library, so y…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-18 04:24 · DEV Community — Machine Learning
SQuAD's answer normalizer can mark a wrong answer correct: three verified hazards