AINewsnow

QontoFAQ: A better Information Retrieval Benchmark [R]

Retrieval benchmarks sometimes feel benchmaxxed by models, so we wanted to find a way to tie it as close as possible to my objective: finding the article that answers a product question right . We worked on a new metric which seems more proportional to document relevance, and built up a benchmarkin…

Read the full story at r/MachineLearning ↗

Timeline · 1 report

  1. 2026-09-22 13:45 · r/MachineLearning
    QontoFAQ: A better Information Retrieval Benchmark [R]

More stories

  1. GPT-6 Sol and Luna now available on AI Gateway — Vercel Blog
  2. Anthropic launches Claude Opus 5.5, its first model since Dario Amodei's "pace the frontier" essay, and says it has enhanced safeguards to combat risky behavior (Emma Roth/The Verge) — Techmeme
  3. Trump says AI will be renamed 'super intelligence' in all US documents — The Hill Technology
  4. Amazon blocks Meta’s Muse AI agent — The Verge AI
  5. How Benchling secured multi-tenant AI agents with Amazon Bedrock AgentCore — AWS Machine Learning Blog
  6. Alibaba Unveils New AI Chip, Outlines Plan for Larger Model — Wall Street Journal Technology
  7. Moonshot’s Kimi K3 lands on Amazon in key test for Chinese open-source AI revenue — South China Morning Post Tech
  8. NVIDIA Isaac ROS 5.0 Advances Agentic, Open Source Robotics Development — NVIDIA Blog

Get the daily brief of stories like this at 6:30 every morning →