AINewsnow

32GB to 64GB of RAM took Qwen3.8-Flash-Next from IQ2_XS (2-bit) to Unsloth UD-IQ4_XS (4-bit) on a single 4090

I went from 32GB to 64GB of DDR5-5800 this week and moved my Strata setup off IQ2_XS. Box: RTX 4090 24GB, i9-14900K, 64GB DDR5-5800, Arch. The models sit on a SATA SSD (~550 MB/s), so anything Strata has to pull from disk while it generates hurts. I wanted every expert in RAM or VRAM. I skipped UD-…

Read the full story at r/LocalLLM ↗

Timeline · 3 reports

  1. 2026-10-19 12:22 · r/LocalLLM
    Qwen3.8-Flash-Next-FP4-Local: Strada, RTX Pro 4500 32 VRAM, 64 GB DDR5
  2. 2026-10-18 17:49 · r/LocalLLM
    Qwen3.8-Flash-Next UD-IQ4_XS on 64 GB RAM + RX 9070 XT with Strata — around 40 tokens/s
  3. 2026-10-18 05:14 · r/LocalLLM
    32GB to 64GB of RAM took Qwen3.8-Flash-Next from IQ2_XS (2-bit) to Unsloth UD-IQ4_XS (4-bit) on a single 4090

More stories

  1. DeepInfer: High-performance inference framework for DeepSeek models — Hacker News Front Page
  2. NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation — Hugging Face Blog
  3. ‘Open your doors for AI’: German chancellor urges businesses to embrace AI as Nvidia announces new investments — CNBC Technology
  4. A Deep Dive on CoreWeave Innovations for NVIDIA Vera Rubin NVL72 — CoreWeave Blog
  5. Germany Wants to Lead the World in Industrial AI: How NVIDIA Will Help — NVIDIA Blog
  6. One Search, Two Layers: Compiler Controls Inside PyTorch Helion using NVIDIA CompileIQ — PyTorch Blog
  7. NVIDIA Advances Agentic Security for Media, From European Public Service Broadcasting to Global Content Production — NVIDIA Blog
  8. Google unveils TorchTPU in a push to break Nvidia's stranglehold on AI compute — SiliconANGLE AI

Get the daily brief of stories like this at 6:30 every morning →