what do you score when the failure only exists across five turns?
how do you test a memory failure when every reply passes on its own? across 4 product teams we've got 12800 travel sessions at 5 turns each, exactly 64000 turns, and per turn relevance is 97.6%. clean on paper. but 947 sessions, about 7.4%, reoffer an itinerary that was rejected earlier because com…
Read the full story at r/AI_Agents ↗
Timeline · 1 report
- 2026-10-10 18:23 · r/AI_Agents
what do you score when the failure only exists across five turns?