Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max.
DeepSeek-V4.1-Flash gets Maya-XS - the whole model in a 128 GB PC's memory - tensor parallel on several GPUs, and much faster drafting on one GPU.
Read the full story at r/LocalLLaMA ↗
Timeline · 9 reports
- 2026-10-25 03:48 · r/LocalLLaMA
Too good to be true? ISTA's GSQ-RCO 2-bit DeepSeek-V4.1-Flash scoring the same as the base model - 2026-10-24 16:29 · r/LocalLLaMA
10 tok/s Deepseek V4.1 Flash 8K with Strata on a 5090 with 64GB DDR5 Ram - 2026-10-24 08:05 · r/LocalLLM
[Release] ISTA GSQ-RCO GGUFs for DeepSeek-V4.1-Flash-1017 - 2026-10-24 08:05 · r/LocalLLaMA
[Release] ISTA GSQ-RCO GGUFs for DeepSeek-V4.1-Flash-1017 - 2026-10-23 23:38 · r/LocalLLM
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO - 2026-10-23 23:37 · r/LocalLLaMA
ISTA-DASLab/DeepSeek-V4.1-Flash-1017-GSQ-RCO - 2026-10-23 20:06 · r/huggingface
5.5× llama.cpp’s prefill throughput on DeepSeek V4.1 Flash 1017 GGUF: TensorSharp benchmarks and quality checks - 2026-10-23 18:32 · r/LocalLLM
Full DeepSeek-V4.1-Flash-1017 (510 GB, original weights) on a 64 GB RAM + RTX 3060 12 GB PC: up to 7.4 tok/s, 98.3% agreement with the full model. Engine released (Apache-2.0) - 2026-10-23 11:49 · r/LocalLLaMA
Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max.