Measuring Whether an LLM Gives the Same Answer Twice, in 30 Lines of JavaScript
This story is from 2026-10-30. It is preserved in the archive; the latest stories are on the live feed.
Ask a model the same question twice and you may get two different lists. If you are testing what an assistant recommends, one run is an anecdote. You need a number for how much the answers repeat, and that number is cheap to compute. We hit this while running a small study of which business directo…
Read the full story at DEV Community — AI ↗
Timeline · 1 report
- 2026-10-30 14:34 · DEV Community — AI
Measuring Whether an LLM Gives the Same Answer Twice, in 30 Lines of JavaScript