Study Examines How Inference-Time Expert Deactivation Alters Routing and Weights in MoE Models
This story is from 2026-11-05. It is preserved in the archive; the latest stories are on the live feed.
A new arXiv paper analyzes expert deactivation at inference time, showing it changes both token routing and expert weights, with performance effects depending on how these changes are implemented.
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-11-05 05:00 · arXiv cs.CL
Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation