LongMemEval-S: 96.0% with the official judge, and what top-5 vs top-20 retrieval changes [R]
This story is from 2026-11-15. It is preserved in the archive; the latest stories are on the live feed.
We ran all 500 LongMemEval-S questions through our memory retrieval (Papr) using the official answer prompt and the unmodified gpt-4o-2024-08-06 judge. Per-question answers and judge labels are public, so the official metrics script reproduces the numbers. Results For comparison, Chronos reports 95…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-11-15 05:40 · r/MachineLearning
LongMemEval-S: 96.0% with the official judge, and what top-5 vs top-20 retrieval changes [R]