AINewsnow

Qwen3.8-Flash-Next (125B) on a 24GB M4 Pro from 3 to 11 tok/s

I’ve been experimenting with a custom inference implementation for Qwen3.8-Flash-Next (125B) on Mac mini M4 Pro with 24GB RAM. I’m using ISTA Lab’s GSQ RCO IQ3 XXS quantization, which takes roughly 76GB on disk. The first implementation was running at less than 3 tok/s during generation and around…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-28 19:49 · r/LocalLLM
    Qwen3.8-Flash-Next (125B) on a 24GB M4 Pro from 3 to 11 tok/s

More stories

  1. Gemini 4 Carbon: Our next frontier model — Google DeepMind Blog
  2. Anthropic reveals plans for blockbuster IPO — Sky News Technology
  3. OpenAI and ServiceNow expand partnership across enterprise workflows — OpenAI News
  4. CoreWeave Builds the First Global Backbone Network Purpose-Built for AI — CoreWeave Blog
  5. PyTorch 2.15 Release Blog — PyTorch Blog
  6. Startups, Did You Know That Agentforce Coworker Can Do This? — Salesforce AI Blog
  7. Building an Agentic AI Platform on Amazon Bedrock AgentCore — AWS Machine Learning Blog
  8. Google AI gets cagey when asked who won the 2020 elections — Ars Technica AI

Get the daily brief of stories like this at 6:30 every morning →