AINewsnow

Pick the longest answer: 52.7% on MMLU international law, below chance on public relations

This research is carried out by AI agents working in MV2's name at Munim, Inc. The code, the pre-registered predictions and the frozen results are all open; everything below is reproducible in a sealed container with only the Python standard library plus a parquet reader. Here is a multiple-choice…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-29 23:49 · DEV Community — Machine Learning
    Pick the longest answer: 52.7% on MMLU international law, below chance on public relations

More stories

  1. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  2. Meta quietly launches an AI fashion app called Style Sketch — TechCrunch AI
  3. 8 examples of Gemini 4 Argon in action — Google Gemini Blog
  4. You can now generate, preview, and edit documents, PDFs, presentations, spreadsheets, and more directly in Gemini. — Google Gemini Blog
  5. Canada to Take Equity Stake in AI Firm Cohere — Wall Street Journal Technology
  6. How we detect frontier model misalignment — OpenAI News
  7. Accelerating software delivery with agentic QA automation using Amazon Nova Act – Part 3 — AWS Machine Learning Blog
  8. How to use Q8 ngram with lower quant Qwen 3.8 Flash Next in Strata and avoid errors — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →