High-performance 35B MoE on everyday hardware: The APEX-I NanoPlus Collection (13.4 GB, ARC 95.7%)
Running 35B MoE models usually consumes nearly all your available memory, leaving almost zero room for context and causing frustrating performance drops. The APEX-I NanoPlus collection solves this by bringing the total footprint down to ~13.4 GB. By keeping critical attention layers (Q/K/V) and rou…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-25 04:18 · r/LocalLLM
High-performance 35B MoE on everyday hardware: The APEX-I NanoPlus Collection (13.4 GB, ARC 95.7%)