AINewsnow

MoMoE: a fork of Strata for more MoE models, on one GPU + system RAM (Linux/NVIDIA, Apple Silicon)

My spare time project: MoMoE (More MoEs), an open-source (MIT) fork of Strata ( https://github.com/Niko1221/Strata ). Strata runs Qwen3.8-Flash-Next on one graphics card plus system RAM; MoMoE includes that and something similar for many other mixture-of-experts models. I've tested it only on the h…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-23 06:17 · r/LocalLLM
    MoMoE: a fork of Strata for more MoE models, on one GPU + system RAM (Linux/NVIDIA, Apple Silicon)

More stories

  1. NVIDIA's Dory 1.0 4B (looped reasoning model) on Apple Silicon with MLX: 101 tok/s at 1 loop, 69 at 2, on an M5 Max (4.2 GB 8-bit build) — r/LocalLLM
  2. Kazakhstan Expands Compute for Its AI Future — NVIDIA Blog
  3. Cognition Becomes First Customer for NVIDIA Vera Rubin NVL72 on CoreWeave Cloud — CoreWeave Blog
  4. NVIDIA Unveils Minerva to Bring End-to-End Observability for AI Factories — NVIDIA Blog
  5. How to Read Data into GPU Memory in Python with NVIDIA GPUDirect Storage — NVIDIA Technical Blog
  6. Get Started with Kimi K3 on CoreWeave Dedicated Inference — CoreWeave Blog
  7. Why AI Factories Need Proof Before Production — CoreWeave Blog
  8. CoreWeave Leads MLPerf 0.7 Endpoints Benchmark with DeepSeek-R1 — CoreWeave Blog

Get the daily brief of stories like this at 6:30 every morning →