[Paper] LatentLoop: Scaling Looped MoE Models with Asymmetric Compute Allocation
Looped Mixture-of-Experts (MoE) models combine parameter reuse with sparse computation to improve performance under matched budgets. Prior work demonstrates that different loop visits can play different roles even when they share parameters. To probe the contributions of different loop visits, we l…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-23 06:50 · r/LocalLLaMA
[Paper] LatentLoop: Scaling Looped MoE Models with Asymmetric Compute Allocation