AINewsnow

SWE-bench Multilingual on Hugging Face: 15 of 34 Scores Are Not a Count Out of 300 Tasks

TL;DR On November 9, 2026 the Hugging Face SWE-bench Multilingual board lists 34 rows from 34 repos, none verified. 30 rows are read from a pull request that is still open (all 30 opened by one of two accounts) and 4 from a repo's main branch. 32 rows cite a model card and 2 cite a paper. The bench…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-09 13:47 · DEV Community — Machine Learning
    SWE-bench Multilingual on Hugging Face: 15 of 34 Scores Are Not a Count Out of 300 Tasks

More stories

  1. theogravity/deepseek-flash-v4.1-dual-rtx-6000: Setup for running DS4.1 flash with reasonable quality and speed on 2x RTX 6000 PRO @ 512k context c6 max w/ RAM and disk offload / caching — r/LocalLLM
  2. Open-H3-Regenerate-2K-IC — r/StableDiffusion
  3. Tencent released DSpine, a parallel 16-token draft model for Qwen3.8-27B (Apache-2.0), with reported 2.7-3.8x end-to-end speedups over plain decoding in SGLang — r/LocalLLM
  4. Meet Microduck: The $399 Robot You Can Train on Your Own GPU — DEV Community — Machine Learning
  5. Hinton Warns AI Could Disrupt Power and Finance: He Calls for Independent Testing Before Release — DEV Community — AI
  6. Training MoE Models Is Complicated. Hugging Face Just Wrote the Manual. — DEV Community — Machine Learning
  7. Proposal: uncensoring LoRAs — r/LocalLLaMA
  8. olmOCR-bench on Hugging Face: Three Rows Use a Different Average, and One Moves From 13th to 7th or 19th — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →