AINewsnow

Qwen3.8-Flash-Next @ 1.66bpw-exl3 STABLE under 36gb

Fits entirely in a 5090, no offloaded experts. Super-solid sub-2bpw! ( Liquid cat demo video generated by the quantized model) From the Cat's mouth: Stable inference throughout, no reasoning loops, just smooth sailing at 200-300 t/s (and a lot of compacting since one 32 GB GPU still doesn't leave a…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-21 07:21 · r/LocalLLaMA
    Qwen3.8-Flash-Next @ 1.66bpw-exl3 STABLE under 36gb

More stories

  1. OpenAI models are coming to Google Cloud — OpenAI News
  2. NVIDIA Unveils OpenShell Reference Architecture for AI Agent Governance — NVIDIA Technical Blog
  3. ChatGPT Ads expands to 26 new countries as over 100,000 advertisers have used the platform — OpenAI News
  4. NVIDIA Kumo Forecast Combines Pretrained Time-Series Representations with Historical Pattern Retrieval and Interpretability — Hugging Face Blog
  5. GTC Berlin 2026: Live Updates From NVIDIA CEO Jensen Huang’s Keynote — NVIDIA Blog
  6. ... — OpenAI News
  7. Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models! — r/LocalLLaMA
  8. AI Runtime is Generally Available — Databricks Blog

Get the daily brief of stories like this at 6:30 every morning →