AINewsnow

RTX PRO 4000 Blackwell SFF: +67% generation on Qwen3.8 27B, +36% on Qwen3.6 35B A3B

My RTX PRO 4000 Blackwell SFF went from 35.04 to 58.53 tok/s on Qwen3.8 27B with DFlash2. That is +67% generation throughput after combined power and clock tuning. The more useful result was that my second Qwen needed different settings. At 8,000 input tokens, ECC OFF: Qwen3.8 27B (NVFP4 + DFlash2)…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-25 22:21 · DEV Community — Machine Learning
    67% more tokens/s on an RTX PRO 4000 Blackwell SFF: why prefill, decode and ABBA controls told different stories
  2. 2026-10-25 21:43 · r/LocalLLM
    RTX PRO 4000 Blackwell SFF: +67% generation on Qwen3.8 27B, +36% on Qwen3.6 35B A3B

More stories

  1. I 'hacked' Krea 2 to work with Pose Studio because I was tired of Qwen/Klein's lack of style diversity and realism — r/StableDiffusion
  2. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
  3. Qwen 3.8 Flash Next Gyro Coder is out! — r/LocalLLaMA
  4. r9700 ai pro + 64gb ram, What QFN model to run and what engine? — r/LocalLLM
  5. how much difference does kv cache quants even make? — r/LocalLLaMA
  6. I ran local AI inference (AMD GPU) for 30 days and measured every watt — here's the real cost vs cloud APIs — r/LocalLLM
  7. "We are Claude" — r/LocalLLM
  8. Come On, even Qwen and GLM uses code to generate random number. Argon why? — r/GeminiAI

Get the daily brief of stories like this at 6:30 every morning →