Replication Without Persistence in Hosted LLMs: Measurement Sensitivity in Action-Time Belief Evaluation
This story is from 2026-09-22. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.22478v1 Announce Type: new Abstract: Behavioural evaluations of hosted language models can vary because the evaluated service, the measurement instrument, or both differ across runs. We separate three validation questions: whether a prior finding recurs on fresh data under its historical…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-09-22 04:00 · arXiv cs.AI
Replication Without Persistence in Hosted LLMs: Measurement Sensitivity in Action-Time Belief Evaluation