Study Uses Causal Interventions to Probe Expert Routing in MoE Language Models
A new arXiv paper examines how forcing tokens onto chosen expert sequences in mixture-of-experts language models reveals what routing controls across layers.
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-11-18 05:00 · arXiv cs.CL
What MoE Routing Controls: Causal Interventions on Expert Trajectories