Qwen3.8-Flash-Next (125B) at ~100 tok/s on an M5 Ultra Mac Studio with llama.cpp

Coverage of "Qwen3.8-Flash-Next (125B) at ~100 tok/s on an M5 Ultra Mac Studio with llama.cpp" from 1 source, with a live timeline of who reported what and when.

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-10 03:21 · r/LocalLLM
Qwen3.8-Flash-Next (125B) at ~100 tok/s on an M5 Ultra Mac Studio with llama.cpp

More stories

feat: add GLM5Next MTP, optimize by pwilkin · Pull Request #29928 · ggml-org/llama.cpp — r/LocalLLaMA
Qwen 3.6 35B A3B: 131K context + vision on 6GB VRAM — r/LocalLLaMA
Tested Mellum2.1-12B-A2.5B on PI Coding Agent - surprisingly usable, but not great at one-shot projects — r/LocalLLaMA
Running the uncensored Qwen3.8-27B (HauhauCS) on a 4090 at 262K context and ~130 tok/s — r/LocalLLaMA
Java vllm-like framwork claims 90% of perfomance of llama.cpp on local inference on NVIDIA GPUs by compiling Java to CUDA and cuTile — r/LocalLLM
Found a fix for AMD RX 6600 100% CPU usage — r/LocalLLM
I made a free Mac app that runs local models: chat, pictures, video and voices — r/LocalLLM
I have an ESC4000 G3 with 8x T4s in it - what is the fastest way I can deploy Qwen3.5-9B for about 10-15 users concurrently: currently using llama.cpp — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →