AINewsnow

Flash Next (Q2) on a 24GB M5 MacBook Air: 49 t/s decode with Splash expert streaming

Qwen3.8-Flash-Next (ISTA GSQ-RCO Q2_0) + Flash-Next-DFlash2 draft on a MacBook Air M5 (24 GB), on Splash 1.4.0 with a small fork. Experts that don't fit are streamed from the SSD: 6,800 of 24,576 expert slots (~28%) live in ~8.8 GB, the rest is read on demand, 256K context. Decode | Setup | code |…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-25 10:55 · r/LocalLLaMA
    Flash Next (Q2) on a 24GB M5 MacBook Air: 49 t/s decode with Splash expert streaming

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. NCERT introduces 20-hour AI module for classes 9-12, covers deepfakes and data privacy — Mint AI
  3. Thomas L. Friedman: We Just Set Off the Second Big Bang — New York Times AI
  4. Two outsiders found ways OpenAI’s AI agents could slip past the system built to catch them — r/OpenAI
  5. Qwen 3.8 Flash Next (Q4) got stuck on this loop for hours. I wonder if this is the AI equivalent of having a nightmare and not being able to wake up — r/LocalLLM
  6. Black Forest Labs' FLUX 3 Klein Runs Image Generation on 8GB GPUs — AlphaSignal
  7. Full DeepSeek-V4.1-Flash-1017 (510 GB) on an RTX 3060 12 GB + 64 GB DDR4 + NVMe: 5.8 tok/s cold, 7.4 warm, >97% exact quality. — r/LocalLLM
  8. Securing our frontier model training environment — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →