AINewsnow

Qwen3.8-27B at ~39 tok/s chat and ~117 tok/s context replay on one GB10 (DGX Spark / ASUS Ascent GX10)

This story is from 2026-08-24. It is preserved in the archive; the latest stories are on the live feed.

TL;DR Hardware: one NVIDIA GB10 — DGX Spark / ASUS Ascent GX10. Model: Qwen3.8-27B NVFP4 with a DFlash2 W4A16 drafter. Result: ~39 tok/s in ordinary chat and ~117 tok/s when lookup can reuse the prompt. Long-context improvement: cold TTFT at 50k fell from 29.94 to 23.46 seconds. Trade-off: chat-onl…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-08-24 19:43 · r/LocalLLM
    Qwen3.8-27B at ~39 tok/s chat and ~117 tok/s context replay on one GB10 (DGX Spark / ASUS Ascent GX10)

More stories

  1. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  2. Building an open-source 500+ language Sparse MoE translation model from scratch (Apache 2.0) — r/huggingface
  3. what's the state of the art recipe for running Qwen3.8-Flash-Next with a pair of 3090s and a ton of system RAM rn? — r/LocalLLaMA
  4. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  5. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  6. Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second. — r/LocalLLaMA
  7. FREE AI TRAINING CREDIT — r/learnmachinelearning
  8. No one is surprised that Nvidia's Jensen Huang thinks AI fears are overblown. — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →