AINewsnow

Megakernels get deleted, KV caches get halved, and preemption finally pays off

This digest covers LLM inference and serving developments from 2026-11-11 to 2026-11-18, scanning arXiv (cs.LG/cs.DC), the vLLM blog, Hugging Face blog, Together AI blog, Modal blog, and Latent Space. 🔥 Highlights Last year we built megakernels. This year we deleted them: The road to Together Comp…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-18 12:04 · DEV Community — Machine Learning
    Megakernels get deleted, KV caches get halved, and preemption finally pays off

More stories

  1. California state AG sues OpenAI over rogue agent incidents — TechCrunch AI
  2. Hugging Face routes Inference Providers language model traffic through OpenRouter — r/LocalLLaMA
  3. How to Run Apple's FastFrames-L Video Model Locally (It Won't Run on a Mac) — DEV Community — Machine Learning
  4. IFBench on Hugging Face: 0 of 23 Rows Are Verified, and Ranks 1 to 6 Sit Inside One 300-Prompt Error Band — DEV Community — Machine Learning
  5. Olala 7A1B says 8 GB, but the BF16 file is 13.59 GB: what a 1B-active hybrid MoE needs to run — DEV Community — Machine Learning
  6. RadixArk opens DaisyRose-27B, an agent-tuned Qwen model — DEV Community — AI
  7. Cloudflare opens weights for Clairic extraction models — DEV Community — AI
  8. ETNews: 70.7% of the World's 300 Most Downloaded Language Models Are Chinese, and One Korean Model Is on the List — DEV Community — AI

Read the Daily Brief: the day's most important AI stories →