AINewsnow

GLM-5.3-Flash (320B) on an M5 Ultra Mac Studio with llama.cpp: 61 tok/s, 262K context

Test machine: M5 ultra. 36/80. 256GB. TL;DR ~61 tok/s generation with GLM’s built-in MTP head (probabilistic drafting, 3 draft tokens), up from 39.7 without it. Prompt reading is the weak spot: ~765 tok/s at 4K tokens and ~630 tok/s at 59K. A 29K-token prompt takes 45 s. The full 262K context fits…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-12 05:12 · r/LocalLLM
    GLM-5.3-Flash on a Mac Studio with oMLX: 61 tok/s and a 29K-token prompt in 15 seconds
  2. 2026-10-10 18:07 · r/LocalLLM
    GLM-5.3-Flash (320B) on an M5 Ultra Mac Studio with llama.cpp: 61 tok/s, 262K context

More stories

  1. I clustered two old Android phones to run a 27B LLM locally. Bypassed RAM limits via C++ RPC split and Hadamard Ternary math (No overheating) — r/LocalLLM
  2. Z.ai Unveils GLM-Legal, an Agentic Model for Legal Workflows — Unite.AI
  3. Ternary Bonsai 2 27B on a $250 Intel Arc B580: writes a working snake game at 108 t/s, 89 t/s at 115K context (open source) — r/LocalLLM
  4. llama.cpp optimizations for specific hardware and models — r/LocalLLaMA
  5. Qwen3.8-Flash-Next on an RTX 5090: 128GB RAM: IQ3_XXS vs IQ3_S vs UD-IQ4_XS — Speed and Accuracy with Strata — r/LocalLLM
  6. Benchmarked Strata 0.1.25 and 0.1.39 against llama.cpp on three cards: an RTX PRO 6000 (96 GB), a 3090 Ti and a 5090 laptop — r/LocalLLM
  7. Z.ai Opens Gated Access to GLM-Legal, Its 320B Legal AI — AlphaSignal
  8. Qwen 3.8 27B Q4_K_M running on a OnePlus 13 with 24 GB RAM — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →