AINewsnow

Qwen3.8-Flash-Next 125B Q2_0 on a 24GB M4 Mac mini: ~8.1 tok/s with Strata

Hi everyone, first post here! I’m a computer science professional exploring self-hosted LLMs and fine-tuning. I wanted to share a small experiment on my Mac mini. Setup Apple M4 Mac mini, 24GB unified memory, internal SSD. Qwen3.8-Flash-Next 125B, GSQ-RCO Q2_0 quantization. Strata , Metal backend,…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-18 23:41 · r/LocalLLM
    Qwen3.8-Flash-Next 125B Q2_0 on a 24GB M4 Mac mini: ~8.1 tok/s with Strata

More stories

  1. Amazon launches Bee Frontier AI wearable amid privacy concerns — CNBC Technology
  2. Meta launches Muse Spark open model to challenge China’s AI dominance — Mint AI
  3. Cohestry is an iOS/Mac native second brain that auto links your notes and grants your agents access to then via MCP — r/ArtificialInteligence
  4. Spy Games in Silicon Valley — Wall Street Journal Technology
  5. Google makes SynthID Detector tool available to everyone to detect artificial intelligence content — DEV Community — Machine Learning
  6. 72 hours, four big open weights drops. The only one that fits in 24GB came from NVIDIA, of all companies. — r/LocalLLaMA
  7. Germany's New Robot Billionaire Is Betting Big On Humanoid Gyms — Forbes AI
  8. I built a tool with Claude that reads 10 years of my notes and maps the ideas I keep coming back to — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →