AINewsnow

MoEShift vs Strata on a 24GB M4 Pro Mac mini - 125B MoE inference benchmarks

Following up on my previous post, I ran some benchmarks comparing MoEShift , the inference engine I've been working on, with Strata. Both were tested on a Mac mini M4 Pro with 24GB unified memory, using Qwen3.8-Flash-Next (125B) with ISTA-DASLab's GSQ-RCO IQ3_XXS quantization . With a short prompt…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-29 11:15 · r/LocalLLM
    MoEShift vs Strata on a 24GB M4 Pro Mac mini - 125B MoE inference benchmarks

More stories

  1. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  2. 8 examples of Gemini 4 Argon in action — Google Gemini Blog
  3. How we detect frontier model misalignment — OpenAI News
  4. Google’s AI Mode won’t say Biden won the 2020 election in the U.S. But in other countries, it’s a different story — Fast Company AI
  5. How Anthropic ships the #1 LLM in the World safely: Separating the Brain from the Hands — Latent Space
  6. Voice AI in vogue: Nvidia releases new open transcription model — TechCrunch AI
  7. The Future Is for Everyone: Meta and CNIB Partner to Support Canadians Who Are Blind, Deafblind or Have Low Vision — Meta Newsroom
  8. An updated Model Spec for more capable and beneficial AI — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →