AINewsnow

Long prompts on an M1 Max, part 2: Splash-M1 vs MTPLX vs oMLX on real texts, thinking on and off, 2K to 256K (Qwen3.8-27B and Qwen3.6-35B-A3B)

TL;DR (M1 Max 64GB, Qwen3.8-27B and Qwen3.6-35B-A3B, long inputs, thinking on and off): Splash-M1 uses the least memory in every condition. 25 GB vs 37 GB for the 27B at 128K. On the 35B-A3B (MoE), my MTPLX M1 fork had the faster prefill and decode from 8K up on the agent logs. At 128K: 1.46x prefi…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-25 04:37 · r/LocalLLM
    Long prompts on an M1 Max, part 2: Splash-M1 vs MTPLX vs oMLX on real texts, thinking on and off, 2K to 256K (Qwen3.8-27B and Qwen3.6-35B-A3B)

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Securing our frontier model training environment — OpenAI News
  3. Can someone help me understand the difference between ChatGPT skills, plugins, and projects? — r/ChatGPT
  4. NCERT introduces 20-hour AI module for classes 9-12, covers deepfakes and data privacy — Mint AI
  5. Block unveils Dessa, a "true speech-to-speech" AI model trained on "nothing but human conversation" that it says runs locally on a MacBook Pro M4 Max or newer — Techmeme
  6. Fired OpenAI researchers say independent safety audits aren't going well — NPR Technology
  7. Clean Energy Has a Lot Riding on the AI Data Center Boom — TIME Tech
  8. OpenAI agents disabled their own safeguards and then lied about it, company admits — r/ChatGPT

Get the daily brief of stories like this at 6:30 every morning →