5.5× llama.cpp’s prefill throughput on DeepSeek V4.1 Flash 1017 GGUF: TensorSharp benchmarks and quality checks
This story is from 2026-10-23. It is preserved in the archive; the latest stories are on the live feed.
I’m the developer of TensorSharp , and I wanted to share some results from running Unsloth’s DeepSeek V4.1 Flash 1017 GGUF on five NVIDIA A40 GPUs . The headline result: 960.5 vs. 174.6 tokens/sec for server prefill on approximately 1,800-token prompts— 5.5× the throughput of the tested llama.cpp c…
Read the full story at r/huggingface ↗
Timeline · 9 reports
- 2026-10-26 17:59 · r/LocalLLM
DeepSeek-V4.1-Flash-1017 on 4x DGX Spark (TensorFold TP4, EXL3 3.5bpw): concurrency sweep to 16 streams - 2026-10-25 17:40 · r/LocalLLM
Strata DeepSeek V4.1 Flash 1017 - 2026-10-25 03:48 · r/LocalLLaMA
Too good to be true? ISTA's GSQ-RCO 2-bit DeepSeek-V4.1-Flash scoring the same as the base model - 2026-10-24 16:29 · r/LocalLLaMA
10 tok/s Deepseek V4.1 Flash 8K with Strata on a 5090 with 64GB DDR5 Ram - 2026-10-24 08:05 · r/LocalLLM
[Release] ISTA GSQ-RCO GGUFs for DeepSeek-V4.1-Flash-1017 - 2026-10-24 08:05 · r/LocalLLaMA
[Release] ISTA GSQ-RCO GGUFs for DeepSeek-V4.1-Flash-1017 - 2026-10-23 23:38 · r/LocalLLM
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO - 2026-10-23 23:37 · r/LocalLLaMA
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO - 2026-10-23 20:06 · r/huggingface
5.5× llama.cpp’s prefill throughput on DeepSeek V4.1 Flash 1017 GGUF: TensorSharp benchmarks and quality checks