Why does a local LLM give a different score every time, and does temperature 0 fix it?
Give a language model a CV and ask for a score from 1 to 10, and you get a number and a confident reason. Ask again and the number can move. The usual advice is "set temperature to 0", which is correct but leaves two questions open: how much does the score actually move with default settings, and w…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-09 06:46 · DEV Community — Machine Learning
Why does a local LLM give a different score every time, and does temperature 0 fix it?