Megakernels get deleted, KV caches get halved, and preemption finally pays off
This digest covers LLM inference and serving developments from 2026-11-11 to 2026-11-18, scanning arXiv (cs.LG/cs.DC), the vLLM blog, Hugging Face blog, Together AI blog, Modal blog, and Latent Space. 🔥 Highlights Last year we built megakernels. This year we deleted them: The road to Together Comp…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-18 12:04 · DEV Community — Machine Learning
Megakernels get deleted, KV caches get halved, and preemption finally pays off