I measured how deterministic LLMs actually are, prompt by prompt. The results broke my hypothesis.
This story is from 2026-09-16. It is preserved in the archive; the latest stories are on the live feed.
A 3D heatmap of 320 model calls, and the four bugs that almost made it lie. Temperature 0 is supposed to mean deterministic. Same prompt in, same bytes out, every time. It's the setting people reach for when they need reproducible output, and it's the setting most of us assume makes an LLM behave l…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-09-16 05:13 · DEV Community — AI
I measured how deterministic LLMs actually are, prompt by prompt. The results broke my hypothesis.