temperature=0 Isn't Deterministic: 17 of 5,000 Greedy Tokens Flipped
I had a regression test that sent the same prompt to an LLM endpoint with temperature=0 and diffed the output against a saved golden file. It passed on Monday. It failed on Tuesday. Same prompt, same model, same parameters. The two outputs matched word for word for about 140 tokens, then one said "…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-14 15:41 · DEV Community — Machine Learning
temperature=0 Isn't Deterministic: 17 of 5,000 Greedy Tokens Flipped