Agents hallucinated because they were committed to the prompt: how RLHF broke Winograd and Flores's 1986 state machine (and the 1-line fix)
We have all watched an LLM reply "Certainly! Here is how to do Y with PackageX" at Token 1, open a code block, and then at Line 15 calmly invent a performY method that has never existed in the history of the universe. Most developers assume this is a memory defect ("it forgot the docs"). Yet if you…
Read the full story at r/AI_Agents ↗