AINewsnow

LongMemEval-S: 96.0% with the official judge, and what top-5 vs top-20 retrieval changes [R]

This story is from 2026-11-15. It is preserved in the archive; the latest stories are on the live feed.

We ran all 500 LongMemEval-S questions through our memory retrieval (Papr) using the official answer prompt and the unmodified gpt-4o-2024-08-06 judge. Per-question answers and judge labels are public, so the official metrics script reproduces the numbers. Results For comparison, Chronos reports 95…

Read the full story at r/MachineLearning ↗

Timeline · 1 report

  1. 2026-11-15 05:40 · r/MachineLearning
    LongMemEval-S: 96.0% with the official judge, and what top-5 vs top-20 retrieval changes [R]

More stories

  1. OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
  2. ChatGPT, Claude, Gemini and Grok helped plan terror attacks in US government test — The Independent Tech
  3. OpenAI unveils Performance Factory, a Codex-powered system that keeps ChatGPT fast — OpenAI News
  4. ChatGPT and Gemini tested on holiday gift recommendations for a drummer who loves vinyl — Tom's Guide AI
  5. OpenAI launches accounting plugin for ChatGPT to streamline business financial management — Economic Times Tech
  6. OpenAI launches ChatGPT for Sales and Accounting with new partner plugins — OpenAI News
  7. OpenAI Expands ChatGPT for Healthcare With 20+ Plugins and Computer-Use Agents — OpenAI (X)
  8. UK government testers found OpenAI's pre-release GPT-6.2 Astra easier to jailbreak than predecessor — VentureBeat AI

Read the Daily Brief: the day's most important AI stories →