AINewsnow

32GB to 64GB of RAM took Qwen3.8-Flash-Next from IQ2_XS (2-bit) to Unsloth UD-IQ4_XS (4-bit) on a single 4090

I went from 32GB to 64GB of DDR5-5800 this week and moved my Strata setup off IQ2_XS. Box: RTX 4090 24GB, i9-14900K, 64GB DDR5-5800, Arch. The models sit on a SATA SSD (~550 MB/s), so anything Strata has to pull from disk while it generates hurts. I wanted every expert in RAM or VRAM. I skipped UD-…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-17 20:57 · r/LocalLLaMA
    32GB to 64GB of RAM took Qwen3.8-Flash-Next from IQ2_XS (2-bit) to Unsloth UD-IQ4_XS (4-bit) on a single 4090

More stories

  1. DeepSeek releases V4.1-Flash-1017 open-weight model under MIT license — Vercel Blog
  2. NVIDIA RTX Spark Laptops Launch Globally With Local AI Agent Support — NVIDIA Blog
  3. Meta releases 816B-parameter Muse Spark Open model for local Mac deployment — NVIDIA Blog
  4. OpenMOSS Releases Apache-Licensed MOSS-Image Model — r/StableDiffusion
  5. Community debates Qwen 3.8 Flash Next performance and optimization — r/LocalLLaMA
  6. NVIDIA RTX Spark Laptops Launch with Blackwell Graphics and AI Platform — NVIDIA Blog
  7. Vercel Adds Session Affinity to AI Gateway Logs — Vercel Blog
  8. Meta Removes AI Training Language from Terms After Backlash — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →