10 tok/s Deepseek V4.1 Flash 8K with Strata on a 5090 with 64GB DDR5 Ram
https://preview.redd.it/6ty7xuyjyfxh1.png?width=721&format=png&auto=webp&s=ee2bbd9530cf60f1dd80444e646a179a54f1d1cb Ran it on my RTX 5090 with Lexar 4TB NVMe and 64 GB of DDR5 Ram. At this speed it is cheaper to use the API than to pay the electricity for this, unfortunately. So if anyone is wonder…
Read the full story at r/LocalLLaMA ↗
Timeline · 6 reports
- 2026-10-27 06:03 · r/LocalLLaMA
Do GX10s / DGX Sparks Dream of Throttling? Temps across 6 cooling setups running DeepSeek V4.1-Flash (spoiler: no) - 2026-10-26 22:02 · AlphaSignal
Cursor Adds DeepSeek V4.1 Flash Hitting 47.7% for Under $1 per Task - 2026-10-26 17:59 · r/LocalLLM
DeepSeek-V4.1-Flash-1017 on 4x DGX Spark (TensorFold TP4, EXL3 3.5bpw): concurrency sweep to 16 streams - 2026-10-25 17:40 · r/LocalLLM
Strata DeepSeek V4.1 Flash 1017 - 2026-10-25 03:48 · r/LocalLLaMA
Too good to be true? ISTA's GSQ-RCO 2-bit DeepSeek-V4.1-Flash scoring the same as the base model - 2026-10-24 16:29 · r/LocalLLaMA
10 tok/s Deepseek V4.1 Flash 8K with Strata on a 5090 with 64GB DDR5 Ram