AINewsnow

M4 Pro vs M5 Pro (24GB): Qwen 3.8 Flash Next IQ3 with MoEShift at 374 tok/s prefill, 14.7 tok/s decode, 8.5GB peak memory

I benchmarked Qwen3.8-Flash-Next 125B ISTA-DASLab's GSQ-RCO IQ3_XXS quant (76GB on disk), on two Macs with 24GB unified memory using MoEShift backend: Metric M4 Pro (medians) M5 Pro (medians) Short prompt decode (72 input tokens) 9.84 tok/s 14.69 tok/s Long prompt prefill (6,060 input tokens) 199.0…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-11-10 04:46 · r/LocalLLM
    Local LLM vs. frontier agent on real work, not a benchmark: Qwen 3.8 Flash Next came a close second to Claude Opus 5.5
  2. 2026-11-09 12:10 · r/LocalLLaMA
    M4 Pro vs M5 Pro (24GB): Qwen 3.8 Flash Next IQ3 with MoEShift at 374 tok/s prefill, 14.7 tok/s decode, 8.5GB peak memory

More stories

  1. I fine-tuned Qwen 2.5 (3B) with Unsloth to build CyberAgent: An offline AI security agent with 57 tools — DEV Community — AI
  2. Anthropic launches Claude Sheets, Whiteboards and Data as Fable 5.2 debuts — Anthropic (X)
  3. The phantom life of Alice Huang, alleged Chinese spy who had affair with Nvidia CEO — CSET Georgetown
  4. Anthropic IPO said to be multiple times oversubscribed ahead of record share sale — CNBC Technology
  5. J. Crew debuts AI shopping tool designed to think like a stylist — Fortune AI
  6. Did Claude Code’s ‘don’t ask again’ option accidentally expose your enterprise's passwords and keys? — VentureBeat AI
  7. Cognizant Launches Claude Managed Services With 25,000-Strong Frontier Capability Group — Economic Times Tech
  8. Daily AI briefings track Claude office-suite push, new TPUs and national AI policy — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →