Same Text, Different Prediction: Serving-Context Nondeterminism in Text Classifiers
arXiv:2610.09111v1 Announce Type: new Abstract: Deterministic inference is essential for reliable and trustworthy machine learning. Prior studies of text generation have shown that changing factors such as batch size, batch composition, hardware, or inference engine can alter the generated text, ev…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-08 04:00 · arXiv cs.CL
Same Text, Different Prediction: Serving-Context Nondeterminism in Text Classifiers