AINewsnow

Most realistic benchmarks?

AA and other benchmarks don't reflect what models can really do. Some benchmaxxed models are unusable for anything but poems, albeit being close to the frontier on coding benchmarks. What are the best, most realistic benchmarks you know for coding, agentic research, office work?

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-25 07:24 · r/LocalLLaMA
    Most realistic benchmarks?

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. NCERT introduces 20-hour AI module for classes 9-12, covers deepfakes and data privacy — Mint AI
  3. Thomas L. Friedman: We Just Set Off the Second Big Bang — New York Times AI
  4. Two outsiders found ways OpenAI’s AI agents could slip past the system built to catch them — r/OpenAI
  5. Qwen 3.8 Flash Next (Q4) got stuck on this loop for hours. I wonder if this is the AI equivalent of having a nightmare and not being able to wake up — r/LocalLLM
  6. Black Forest Labs' FLUX 3 Klein Runs Image Generation on 8GB GPUs — AlphaSignal
  7. Full DeepSeek-V4.1-Flash-1017 (510 GB) on an RTX 3060 12 GB + 64 GB DDR4 + NVMe: 5.8 tok/s cold, 7.4 warm, >97% exact quality. — r/LocalLLM
  8. Securing our frontier model training environment — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →