AINewsnow

Qwen3.8-Flash-Next, on 5090+64gb, with Llama.cpp - Seems to not use ram?

I was actually pretty happy with my Qwen3.8-27b setup, and I'd been tinkering with Ninfer to have a version that was "fast but maybe a bit stupid" and the speed was nice to have as a backup. But I was curious how the Flash-Next version might work, after I learned it didn't need to all fit in VRAM t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-24 21:30 · r/LocalLLaMA
    Qwen3.8-Flash-Next, on 5090+64gb, with Llama.cpp - Seems to not use ram?

More stories

  1. Liquid AI Releases LFM2.5-VL-3B-DSpark: Speculative Decoding for Vision-Language Models With Up to 3.13x Faster Decoding — MarkTechPost
  2. Ternary Bonsai 2 27B at up to 532 tok/s on one RTX 4090, native Windows: MTP + n-gram speculative decoding in a from-scratch CUDA engine — r/LocalLLM
  3. Updated from 3x3090(2x3090, 1x3090TI) to 2x5090 — r/LocalLLaMA
  4. is switching from llama cpp to vllm worth it — r/LocalLLaMA
  5. Adding logit penalty for "wait", "maybe" and "perhaps" to Qwen models improves their accuracy — r/LocalLLaMA
  6. Qwen3.8-Flash-Next on 12GB VRAM - 65 tokens per second — r/LocalLLM
  7. JiRackUltra_1b Runs AI Routing on Any Laptop Without a GPU — AlphaSignal
  8. Advice on models for RAG use case — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →