Qwen 35B does 154 tok/s on 2024 Macbook M4 Pro 48GB with Kapitsa: Open-source Apple Silicon optimized custom Metal engine built for Qwen. See benchmarks of Qwen 3.8 27B, Qwen3.6 35B, 3.8 Flash-Next on M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)
hey, my name is Ye, I vibecode at nace.ai and we do a lot of work with enterprises, and a lot of the time we're inside their networks with no internet access and outdated cloud hosted models. considering we work on macbooks, we have built Kapitsa, an open-source Qwen/Nemotron inference engine optim…
Read the full story at r/LocalLLM ↗
Timeline · 4 reports
- 2026-10-21 21:29 · r/LocalLLM
5 desktop agent apps on a local Qwen 3.8 27B (M5 MacBook Pro): my notes - 2026-10-21 04:49 · r/LocalLLM
KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021 - 2026-10-21 04:47 · r/LocalLLaMA
KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021 - 2026-10-19 08:43 · r/LocalLLM
Qwen 35B does 154 tok/s on 2024 Macbook M4 Pro 48GB with Kapitsa: Open-source Apple Silicon optimized custom Metal engine built for Qwen. See benchmarks of Qwen 3.8 27B, Qwen3.6 35B, 3.8 Flash-Next on M1 Pro (16GB), M4 Pro (48GB) and M5 Max (128GB)