New 'Mixture of Wide Experts' Method Aims to Make Language Model Features Interpretable
This story is from 2026-11-04. It is preserved in the archive; the latest stories are on the live feed.
A new arXiv paper proposes Mixture of Wide Experts, a sparse routing approach that keeps model features in interpretable native coordinates, complementing sparse autoencoders which recover concepts spread across many dimensions.
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-11-04 05:00 · arXiv cs.LG
Mixture of Wide Experts: Sparse Routing for Interpretable Native Coordinates