AINewsnow

JetBrains Mellum 2.1 12B A2.5B MoE is a very good model.

It runs at around m4 16 at 60 tps at full 130k context, you can easily run a Q8 if you have a 16 GB GPU, I was able to get 140TPS on 9070xt, It’s an MoE so I think we can run it well on smaller cards too, 8GB, 12GB should be possible to get upwards of 30-40 tps. I have used it a bit, it can code, b…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-14 15:47 · r/LocalLLaMA
    JetBrains Mellum 2.1 12B A2.5B MoE is a very good model.

More stories

  1. Google launches Gemini 4 Argon; Meta releases Muse Wonder — Google DeepMind YouTube
  2. FBI arrests OpenAI engineer for alleged espionage — Sky News Technology
  3. Amazon Bedrock AgentCore enables enterprise AI agents for IT, security, and document processing — AWS Machine Learning Blog
  4. Epic Games releases vibe-coded launcher, claims speed advantage over Steam — Ars Technica AI
  5. Eight US states sue OpenAI over alleged safety risks to children — The Verge AI
  6. Apple launches HomeView smart display and HomePod mini 2 with Siri AI integration — The Guardian AI
  7. Ai2 releases HiRO-ACEv2 for low-cost extreme weather simulation — Allen Institute for AI (Ai2)
  8. Apple to Launch AI Features in China in December — Bloomberg AI

Get the daily brief of stories like this at 6:30 every morning →