Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts
This story is from 2026-09-10. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.09241v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) architectures have emerged as a powerful paradigm for scaling model capacity while preserving efficient inference in large foundation models. However, most MoE models use a fixed top-$k$ expert selection policy, assigning the…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-10 04:00 · arXiv cs.LG
Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts