AINewsnow

A 2013 Mac Pro runs a 35B model at 66 tok/s reading. The first benchmark I trusted was wrong by about 9x.

I ran Qwen3.6-35B on a 2013 Mac Pro (two AMD FirePro D700, 64 GB RAM, original macOS 12) with Vulkan/MoltenVK. Reading runs at 66 tok/s and writing at about 11 tok/s, measured with llama-bench. The bigger lesson: a Metal path I first benchmarked was computing wrong results, and its broken state loo…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-28 15:47 · r/LocalLLM
    A 2013 Mac Pro runs a 35B model at 66 tok/s reading. The first benchmark I trusted was wrong by about 9x.

More stories

  1. I tested LFM2.5-24B-A2B vs Qwen3.6-35B-A3B on 75 fresh multi-step tool tasks. Qwen solved 91%, LFM2.5 49%, and LFM2.5 said "done" on most of its failures — r/LocalLLM
  2. mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cpp — r/LocalLLaMA
  3. shura.cpp: a llama.cpp fork with a VRAM governor, so a 35B MoE can share one 16 GB card with the desktop you keep using — r/LocalLLM
  4. LiquidAI/LFM3-Omni-2B-GGUF — r/LocalLLaMA
  5. Qwen3.8-27B Q6 on one RTX 5090: 69 → 100 tok/s short, 35 → 64 tok/s at 120K context, just by leaving LM Studio for a native llama.cpp build (full benchmarks + recipe) — r/LocalLLM
  6. llmserver – one bash script for local LLMs with model security checks (llama.cpp / vLLM / Ollama) — r/huggingface
  7. Introducing Zest: model server + agent + friendly GUI — r/LocalLLaMA
  8. I made Pumpkin, a graphical manager for llama.cpp for my girlfriend. It turned out well, so I put it on github — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →