AINewsnow

Qwen3.8-Flash-Next UD-IQ4_XS on 64 GB RAM + RX 9070 XT with Strata — around 40 tokens/s

I wanted to share what I’ve achieved running Strata on my desktop. The 94GB Qwen3.8-Flash-Next UD-IQ4_XS model runs locally using a combination of GPU memory, system RAM, and NVMe storage. My hardware and software: AMD Ryzen 7 9800X3D AMD Radeon RX 9070 XT with 16 GB VRAM 64 GB RAM, approximately 6…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-19 12:22 · r/LocalLLM
    Qwen3.8-Flash-Next-FP4-Local: Strada, RTX Pro 4500 32 VRAM, 64 GB DDR5
  2. 2026-10-18 17:49 · r/LocalLLM
    Qwen3.8-Flash-Next UD-IQ4_XS on 64 GB RAM + RX 9070 XT with Strata — around 40 tokens/s

More stories

  1. DeepInfer: High-performance inference framework for DeepSeek models — Hacker News Front Page
  2. NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation — Hugging Face Blog
  3. ‘Open your doors for AI’: German chancellor urges businesses to embrace AI as Nvidia announces new investments — CNBC Technology
  4. A Deep Dive on CoreWeave Innovations for NVIDIA Vera Rubin NVL72 — CoreWeave Blog
  5. Germany Wants to Lead the World in Industrial AI: How NVIDIA Will Help — NVIDIA Blog
  6. One Search, Two Layers: Compiler Controls Inside PyTorch Helion using NVIDIA CompileIQ — PyTorch Blog
  7. NVIDIA Advances Agentic Security for Media, From European Public Service Broadcasting to Global Content Production — NVIDIA Blog
  8. Australian data centre group falls 44% on profit warning — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →