AINewsnow

Built a Vulkan Inference Engine that runs enormous MoE models on consumer AMD GPUs.

This story is from 2026-08-20. It is preserved in the archive; the latest stories are on the live feed.

I got the DeepSeek V4 Flash 0731 (284-billion-parameter) DeepSeek model with 1M context window running locally on a sub-$1,500 AMD PC (sub $1,000 if you buy used!), and open sourced it. On an RX 6700 XT with 12GB of VRAM, ordinary system RAM, and an NVMe SSD. I started this project because running…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-08-20 22:16 · r/LocalLLM
    Built a Vulkan Inference Engine that runs enormous MoE models on consumer AMD GPUs.

More stories

  1. Bolt Adds DeepSeek V4.1 Flash at 10x Cheaper Than V4 Pro — AlphaSignal
  2. DeepSeek’s Insane New Architecture — Two Minute Papers
  3. Jina AI Releases jina-ocr-v1: A 3.4B MoE Document Parser With Built-In Speculative Decoding for Low-Budget GPUs — MarkTechPost
  4. Gemini 4 is good enough - JUST RELEASE IT — r/GeminiAI
  5. Ai used for chatbots — r/artificial
  6. I gave 6 different AIs the same 5 questions — r/AI_Agents
  7. PromptDeck v1.1.0 – open-source desktop app to benchmark local AND cloud LLMs side-by-side (Ollama, LM Studio + OpenRouter, Groq, DeepSeek…) — r/LocalLLaMA
  8. What’s your favorite AI model for coding right now? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →