Researchers propose AlterNet, an adaptive-depth mixture-of-experts architecture for elastic LLM inference
A new paper introduces AlterNet, an LLM architecture combining mixture-of-experts with learned halting so compute demands can adapt at inference time instead of being fixed at training.
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-11-10 05:00 · arXiv cs.AI
AlterNet: Adaptive-Depth Mixture-of-Experts with Learned Halting for Elastic Inference