AINewsnow

Open weights don't make a 1T model cheap to run

This story is from 2026-10-15. It is preserved in the archive; the latest stories are on the live feed.

Mistral Large 4 is 1.05T parameters with 52B active per token. The 52B sets your compute. The 1T sets your memory, because every expert has to stay resident in GPU memory for the router to pick it. At FP8 that is about a terabyte of weights before any KV cache. That makes 8x B200 (1,440 GB) the fir…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-15 08:13 · DEV Community — AI
    Open weights don't make a 1T model cheap to run

More stories

  1. I built Agent Praxis: 6 adversarial environments to test how LLM agents handle traps, metric gaming, and fake authority — r/LocalLLM
  2. The Sequence Learning Loop - Issue 950: Three Models, Three Ways to Make AI Smarter — TheSequence
  3. This video was made by the agents you see in it — r/ChatGPTCoding
  4. Mistral Large 4 Failed My Rubik's Cube Test — Matthew Berman
  5. Mistral is BACK! (Le Chonk) — Matthew Berman
  6. Anthropic reports $16.8 billion Q3 revenue ahead of planned IPO — Bloomberg AI
  7. OpenAI alleges ex-employee took confidential files to Apple — The Verge AI
  8. OpenAI engineer charged with planting surveillance device in office — Sky News Technology

Get the daily brief of stories like this at 6:30 every morning →