Towards a Statistical Understanding of Mixture-of-Experts
This story is from 2026-09-04. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.03501v1 Announce Type: new Abstract: Mixture-of-experts (MoE) architectures increase model capacity by combining a collection of expert predictors through input-dependent routing, while often activating only a small subset of experts for each input. Despite their growing importance in mo…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-09-04 04:00 · arXiv stat.ML
Towards a Statistical Understanding of Mixture-of-Experts