AINewsnow

M5 Max users: what models are you using & what tk/s are you getting?

This story is from 2026-09-06. It is preserved in the archive; the latest stories are on the live feed.

I was using antirez’s ds4 for a while and getting around 20 tk/s, which worked for my purposes. But I know there have been big advancements between Qwen, the DS4 vision model, and GLM. I’m not sure how the quants affect performance, so what’s the best thing to run right now & how fast is it? submit…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-06 01:32 · r/LocalLLaMA
    M5 Max users: what models are you using & what tk/s are you getting?

More stories

  1. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  2. Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLM
  3. US government website used Chinese model the FBI called "malicious" — Ars Technica AI
  4. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  5. Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
  6. Ternary Bonsai 2 27B — r/LocalLLaMA
  7. 10 hours left fo Qwen Image 2.1 Public Open Source Release — r/comfyui
  8. M2 Mac ultra128gb Qwen flash next — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →