Edge0 Streams a 35B Model on Apple Silicon Using Just 3GB

This story is from 2026-09-10. It is preserved in the archive; the latest stories are on the live feed.

Edge0 is an open-source streaming MoE inference framework that offloads experts to SSD and predicts routing ahead, running 35B models on a Mac mini.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-09-10 16:48 · AlphaSignal
Edge0 Streams a 35B Model on Apple Silicon Using Just 3GB

More stories

[Release] Nirvana Code: A single-binary Rust LLM engine built from the metal up for Apple Silicon (Metal 3, Persistent Prefix Cache, Speculative Decoding, Dual GGUF + MLX) — r/LocalLLM
He’s the Face of AI Doomsday Fears — Wall Street Journal Technology
Week in review: OpenAI ships managed Agents API, Apple's new Siri reportedly runs on Gemini, and three vendors add agent spend controls — r/artificial
Running ACE-Step 1.5 and YuE2-3B on one GPU behind a single local UI (CUDA + Apple Silicon): notes from building it — r/LocalLLM
Best open-source model for an M2 Max 32GB and what closed model does it actually compare to? — r/LocalLLM
Apple M6 Pro Geekbench 7 — r/LocalLLaMA
Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro — r/LocalLLaMA
Apple M5 Ultra Scores Big GPU Gains in Leaked Geekbench Benchmark — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →