38 tok/s on a 16 GB Mac mini: a 4-agent coding crew running locally, scored by 8 tests OpenAI wrote
Qwen3.6-35B-A3B is a mixture-of-experts (MoE) model: 35 billion parameters in total, but only about 3 billion used for each word (each of its 40 layers has 256 small experts and picks 8 per word). That's why a 35B model can write at 38 tok/s on a 16 GB Mac. Here's a measured run of a four-agent cod…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-16 07:28 · r/LocalLLM
38 tok/s on a 16 GB Mac mini: a 4-agent coding crew running locally, scored by 8 tests OpenAI wrote