Two ~300B MoE models, each on ONE 128 GB mini PC (AMD Strix Halo): GLM-5.3-Flash at ~580 tok/s prefill, MiMo-V2.6-Flash up to 44 tok/s decode. EXL3 weights + open ROCm engine
This story is from 2026-10-03. It is preserved in the archive; the latest stories are on the live feed.
Coverage of "Two ~300B MoE models, each on ONE 128 GB mini PC (AMD Strix Halo): GLM-5.3-Flash at ~580 tok/s prefill, MiMo-V2.6-Flash up to 44 tok/s decode. EXL3 weights + open ROCm engine" from 1 source, with a live timeline of who reported what and when.
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-03 14:45 · r/LocalLLM
Two ~300B MoE models, each on ONE 128 GB mini PC (AMD Strix Halo): GLM-5.3-Flash at ~580 tok/s prefill, MiMo-V2.6-Flash up to 44 tok/s decode. EXL3 weights + open ROCm engine
More stories
- 27,280 Agent Runs Prove Your Harness Matters More Than Your Model — DEV Community — AI
- Baseten Inference Infrastructure Enters Public Preview on Microsoft Foundry — Unite.AI
- China AI Highflier Crashes 85% as Chip Fears Hit Model Makers — Bloomberg AI
- Alibaba's QwenWork Adds Third-Party Models From Kimi, GLM and DeepSeek — Pandaily
- OpenAI launches GPT-6.2 Astra and Sol as Google ships Gemini 4 Neon and Microsoft unveils MAI Code 2 — OpenAI News
- Anthropic debuts on Nasdaq with record $81.3 billion IPO, hitting $2 trillion value — Anthropic (X)
- Google launches Gemini 4 Neon and opens Genie 4 world model to Gemini API developers — Google DeepMind YouTube
- Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
Read the Daily Brief: the day's most important AI stories →