AINewsnow

Qwen3.8-27B at 42 tok/s single-user on one DGX Spark, fastest single-Spark entry on spark-arena, with 99 to 101% of BF16 quality

I've been tuning Qwen3.8-27B on a single DGX Spark, and the result is now the fastest single-Spark entry for this model on spark-arena. spark-arena's own benchmark (llama-benchy, 128 output tokens): 1 user: 42.2 tok/s (23.7 ms/token), prefill 2,158 tok/s 1 user at 16k context: 33.4 tok/s; at 100k:…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-18 00:12 · r/LocalLLM
    Qwen3.8-27B at 42 tok/s single-user on one DGX Spark, fastest single-Spark entry on spark-arena, with 99 to 101% of BF16 quality

More stories

  1. Developer Mert Cobanov Runs llama.cpp on a Jailbroken PS5 — AlphaSignal
  2. User friendly GUI for configuring and launching llama.cpp — r/LocalLLM
  3. Academic history research agent on 16GB vRAM, context important — r/LocalLLM
  4. What model do you recommend for coding to this hardware? (LLama.cpp) — r/LocalLLM
  5. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
  6. WHIRL 0.2.0 now runs on the AMD Ryzen AI Max+ 395 (Radeon 8060S): native Windows LLM engine, faster than llama.cpp ROCm and Vulkan from 2k to ~250k tokens (also on the Radeon AI PRO R9700) — r/LocalLLM
  7. Arc Pro B60 runs a 27B coding model at 53 tok/s: full recipe, flags and raw logs — r/LocalLLM
  8. Unsloth's Llama 3.2 Mirror Hits 800K Downloads by Removing Meta's Login Wall — AlphaSignal

Get the daily brief of stories like this at 6:30 every morning →