AINewsnow

Serving a 1B math model on vLLM: the memory cap sets how many answers fit, not how fast

Limite 1B Violetto is a math model that ships as one 2.1 GB file, and Paradigma's table puts it at 94.01% on AIME 2026, a US exam for top high school students. We put it on one RTX 4090 on our cloud and gave it the 30 problems once each. The result: 27 correct, 2 wrong, 1 with no final answer. The…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-01 06:34 · DEV Community — Machine Learning
    Serving a 1B math model on vLLM: the memory cap sets how many answers fit, not how fast

More stories

  1. Mistral releases weights for trillion-parameter Le Chonk model with 1M-token context — Wired AI
  2. DeepSeek open-sources prototype of always-on autonomous coding agent — Techmeme
  3. Big Tech sheds nearly $900bn as AI spending fears trigger market rout — Financial Times AI
  4. Beginner lesson plan offers 15-minute introduction to using ChatGPT — Tom's Guide AI
  5. Foxconn hints at new OpenAI tie-up for AI hardware, says no AI bubble — Economic Times Tech
  6. Developers Build Día de los Muertos AI Projects for Hacktoberfest Open-Source Challenge — DEV Community — AI
  7. Claude Code users turn to enforcement techniques as CLAUDE.md guidance proves insufficient — r/AI_Agents
  8. Hacktoberfest 'Ghost in the Machine' challenge draws wave of projects reviving abandoned code and archives — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →