AINewsnow

A TypeScript-only Qwen3.6-35B that runs at 36 tok/s on a 16 GB Mac

We mapped which experts Qwen3.6-35B-A3B uses for TypeScript and kept only those, 96 of 256 per layer, with no training. The result is an 8.8 GB file that runs fully in memory on a 16 GB Mac in stock llama.cpp. Five TypeScript tasks (scored /8 by strict compile + executed Jest tests, no human judgin…

Read the full story at r/huggingface ↗

Timeline · 2 reports

  1. 2026-10-22 20:52 · r/LocalLLM
    A TypeScript-only Qwen3.6-35B that runs at 36 tok/s on a 16 GB Mac
  2. 2026-10-22 20:51 · r/huggingface
    A TypeScript-only Qwen3.6-35B that runs at 36 tok/s on a 16 GB Mac

More stories

  1. Qwen3.8-Flash-Next vs Opus 5.5: Six-way benchmark on a real Rust feature with Claude Code and Pi — r/LocalLLaMA
  2. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  3. Ling-3.0-tiny-UBTree DFlash draft for stock mainline llama.cpp (+8% prose, +61% code speedup) — r/LocalLLaMA
  4. Q4 flash next for £300/600 👀 - snapdragon mini PC results update - 315/43 Tok/s A3b, 46/20 Tok/s Flash Next (read/gen) 💥 — r/LocalLLaMA
  5. Llama Proxy Cache v0.6.0 for llama-server prefill KV cache management — r/LocalLLM
  6. Llama.cpp PR: How to beat strata decode performance with a R9700 — r/LocalLLaMA
  7. Carbon-X: the best open DNA language model runs locally with llama.cpp — r/LocalLLaMA
  8. my llama.cpp frontend somehow hit 100 stars lol, here’s what changed since i posted it — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →