67-84 t/s DeepSeek flash v4 off 2x GX10s
This story is from 2026-08-29. It is preserved in the archive; the latest stories are on the live feed.
Finally achieved usable results with 2 gx10 at over 65 tokens a second sustained. The 2570 prompt eval is really crucial for me as well. Overall stoked 10/10 edit: I followed this setup with 2 ASUS GX10 DGX computers :) https://github.com/tonyd2wild/DeepSeek-v4-Flash-0731-DSpark-1M-NVFP4-KV-2x-DGX-…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-08-29 18:59 · r/LocalLLaMA
67-84 t/s DeepSeek flash v4 off 2x GX10s