Edge0 Streams an 8B AI Model From SSD Using Only 1 GiB

This story is from 2026-09-13. It is preserved in the archive; the latest stories are on the live feed.

Edge0 releases an 8B sparse MoE that runs in under 1 GiB of active memory on Apple Silicon, streaming experts from SSD on demand.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-09-13 13:59 · AlphaSignal
Edge0 Streams an 8B AI Model From SSD Using Only 1 GiB

More stories

[Release] Nirvana Code: A single-binary Rust LLM engine built from the metal up for Apple Silicon (Metal 3, Persistent Prefix Cache, Speculative Decoding, Dual GGUF + MLX) — r/LocalLLM
He’s the Face of AI Doomsday Fears — Wall Street Journal Technology
Week in review: OpenAI ships managed Agents API, Apple's new Siri reportedly runs on Gemini, and three vendors add agent spend controls — r/artificial
Running ACE-Step 1.5 and YuE2-3B on one GPU behind a single local UI (CUDA + Apple Silicon): notes from building it — r/LocalLLM
Best open-source model for an M2 Max 32GB and what closed model does it actually compare to? — r/LocalLLM
Apple M6 Pro Geekbench 7 — r/LocalLLaMA
Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro — r/LocalLLaMA
Apple M5 Ultra Scores Big GPU Gains in Leaked Geekbench Benchmark — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →