AINewsnow

Tencent released DSpine, a parallel 16-token draft model for Qwen3.8-27B (Apache-2.0), with reported 2.7-3.8x end-to-end speedups over plain decoding in SGLang

Tencent put DSpine on Hugging Face on Nov 7. It is a five-layer draft model for speculative decoding with Qwen3.8-27B. Instead of drafting one token at a time, it drafts a 16-token block in parallel, and each layer passes predicted predecessor features to the neighboring positions so the draft stil…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-09 05:42 · r/LocalLLM
    Tencent released DSpine, a parallel 16-token draft model for Qwen3.8-27B (Apache-2.0), with reported 2.7-3.8x end-to-end speedups over plain decoding in SGLang

More stories

  1. Tencent AI chief warns AI will soon master biology, raising new safety risks — South China Morning Post Tech
  2. Tencent AI chief says AI bio capabilities may soon enable harm, backs Anthropic's closed-model stance — Techmeme
  3. Serving a stateful video world model on one RTX 4090: memory, flags and seeds in Hy-Nomas — DEV Community — Machine Learning
  4. Meet Microduck: The $399 Robot You Can Train on Your Own GPU — DEV Community — Machine Learning
  5. Hinton Warns AI Could Disrupt Power and Finance: He Calls for Independent Testing Before Release — DEV Community — AI
  6. Training MoE Models Is Complicated. Hugging Face Just Wrote the Manual. — DEV Community — Machine Learning
  7. Six things happened in AI today; the one worth your attention is ChatGPT Cyber. — DEV Community — Machine Learning
  8. The Filter Changed After the User Tapped Off: Race-Proof Tencent RTC Beauty AR — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →