Elastic MoE scaling, free batch-sorting wins, and DeepSeek's serving stack goes open

This story is from 2026-10-21. It is preserved in the archive; the latest stories are on the live feed.

This digest covers LLM inference and serving developments from 2026-10-14 to 2026-10-21: arXiv (cs.LG/cs.DC), the vLLM and Hugging Face blogs, Together AI, Modal, and Latent Space. 🔥 Highlights Push-Based KV Transfer to Improve TTFT and TPOT for Disaggregated Inference in vLLM — up to 3x better TT…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

2026-10-21 12:13 · DEV Community — Machine Learning
Elastic MoE scaling, free batch-sorting wins, and DeepSeek's serving stack goes open

More stories

DeepSeek V4.1 Flash is now available in Token Pass — Vercel Blog
Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models! — r/LocalLLaMA
U.S. bans AI startup DeepSeek because of ‘threat vectors’ and China responds — Fast Company AI
US orders federal agencies to remove China’s DeepSeek AI from their systems — TechCrunch AI
US bans DeepSeek AI from government systems: What the official notice says about ‘transfer of sensitive data’ to China — Mint AI
US bans China's DeepSeek from government in race for AI dominance — BBC Technology
Washington’s DeepSeek ban may deter US firms from adopting Chinese AI models: experts — South China Morning Post Tech
DeepSeek V3: What It Is and When to Use It — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →