Temperature 0, same model, two different GPUs: find the word that splits them, then pin it
You set the temperature to 0, you fix the seed, you run the same GGUF file, and the two GPUs disagree. One says 20. The other says 2000. Neither of them is wrong about its own arithmetic, and each one repeats itself exactly when you run it a second time. The difference is not in the model, and it i…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-11-08 21:32 · DEV Community — AI
Temperature 0, same model, two different GPUs: find the word that splits them, then pin it