Community GGUF port of Tencent's DSpine lifts Qwen3.8-27B to ~105 tok/s on one GPU

A community GGUF port brings Tencent's DSpine draft model to llama.cpp, pushing Qwen3.8-27B decoding to about 105 tok/s on a single RTX 3090.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-11-08 14:07 · AlphaSignal
Tencent's DSpine Pushes Qwen3.8-27B to 104.8 tok/s on a Single GPU

More stories

Tencent AI chief warns AI will soon master biology, raising new safety risks — South China Morning Post Tech
Nous Research releases Arete-27B, cutting Qwen3.8-27B propaganda rate from 22% to 0.9% — AlphaSignal
Six things happened in AI today; the one worth your attention is Thinking Machines Lab. — DEV Community — AI
Tencent AI chief says AI bio capabilities may soon enable harm, backs Anthropic's closed-model stance — Techmeme
Serving a stateful video world model on one RTX 4090: memory, flags and seeds in Hy-Nomas — DEV Community — Machine Learning
Tencent released DSpine, a parallel 16-token draft model for Qwen3.8-27B (Apache-2.0), with reported 2.7-3.8x end-to-end speedups over plain decoding in SGLang — r/LocalLLM
Continuity Research releases Tess-4.5-27B, cutting local coding agent token use by 25% — AlphaSignal
The Filter Changed After the User Tapped Off: Race-Proof Tencent RTC Beauty AR — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →