AINewsnow

DeepSeek-V4.1-Flash (2-bit, 258 GB) running on a single AMD MI50 32GB: ~23 tok/s decode, ~170 tok/s prefill (Strata + a handful of HIP patches)

I wasn't expecting this to work, so sharing in case it helps other gfx906 owners. Setup - 1x AMD MI50 (gfx906, 32 GB), ROCm 7.1, HSA_OVERRIDE_GFX_VERSION=9.0.6 - 62 GB RAM, 24 threads, NVMe (~4 GB/s measured) - Model: DeepSeek-V4.1-Flash-1017, ISTA-DASLab's IST-DAS 2.00bpw GGUF set (IQ1_M/IQ2_XS/IQ…

Read the full story at r/LocalLLM ↗

Timeline · 5 reports

  1. 2026-10-30 16:46 · r/LocalLLaMA
    ISTA DeepSeek-V4.1-Flash-1017 GSQ-RCO quants comparison
  2. 2026-10-30 13:48 · r/LocalLLaMA
    Introducing DeepSeek-V4.1-Flash-1017 Dynamic v3.1 Unsloth GGUFs
  3. 2026-10-30 00:04 · r/LocalLLM
    Deepseek v4.1 Flash 28.8Tk/s average on 5070Ti 9950X 128gb ram
  4. 2026-10-29 17:46 · r/LocalLLaMA
    Why you can't trust cloud API endpoints: 40 days of coding-agent telemetry showing the exact day providers silently overwrote deepseek-v4.1-flash with -1017 ("faster execution, shorter answers" = 3x more swearing and 6.7x more model switches)
  5. 2026-10-29 08:26 · r/LocalLLM
    DeepSeek-V4.1-Flash (2-bit, 258 GB) running on a single AMD MI50 32GB: ~23 tok/s decode, ~170 tok/s prefill (Strata + a handful of HIP patches)

More stories

  1. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  2. DeepSeek, Moonshot used OpenAI's GPT-6 Astra to train latest models: report — Economic Times Tech
  3. Used Qwen 3.8 flash next on underspeced PC to Root and gut LG TV of spy and adware — r/LocalLLaMA
  4. Run TeleAI's Xing4.0-29B-A4B GGUF via ik_llama.cpp — Full native mHC/MLA runtime + HF converter — r/LocalLLM
  5. I kept one DeepSeek thread going for six days (742 turns, ~560k words) until it hit its limit. The full export, audited and redacted, is on Zenodo. Started a chat in October to analyze an old essay UKA-135: A Proposed Rooted-Tree Ontology of 135 Research Domains with Epistemic Constraint — r/huggingface
  6. dsh-Go Brings DeepSeek's Coding Agent to Android Without Root Access — AlphaSignal
  7. Pareto frontier for an 2xRTX 3090 on a moderate-size community benchmarks collection — r/LocalLLaMA
  8. Tried to get Qwen 3.8 27b to make the deepseek chibi whale in blender and animate it lol — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →