Study examines how inference-time expert deactivation affects routing and weights in sparse models
This story is from 2026-11-06. It is preserved in the archive; the latest stories are on the live feed.
A new arXiv paper analyzes expert deactivation at inference time, showing it changes both token routing and expert weights, and that performance effects depend on how these changes are implemented.
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-11-06 05:00 · arXiv cs.CL
Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation