AINewsnow

Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)

Basalt: Qwen 3.8 FN NVFP4, single 5090 Hi guys, so I finally got a RAM upgrade and have been working on the top two pain points from Basalt: NVFP4 support and faster prefill. NVFP4: Basalt runs NVFP4 natively now, a new .basalt pack keeps stock NVIDIA experts and stores the dense layers as Q6_K. Nu…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-18 00:26 · r/LocalLLM
    Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)
  2. 2026-10-18 00:26 · r/LocalLLaMA
    Basalt: NVFP4 + faster prefill for Qwen3.8 Flash-Next on Blackwell (single 5090)

More stories

  1. Community evaluates Qwen 3.8 Flash Next performance and quantization trade-offs — r/LocalLLaMA
  2. Trained a Qwen-Image-2.1 LoRA with fewer restrictions and omni poses — r/StableDiffusion
  3. 3xrtx8000 48gb... what to do? — r/LocalLLaMA
  4. You don’t need that expensive of a build for local llms. — r/LocalLLaMA
  5. Developer Mert Cobanov Runs llama.cpp on a Jailbroken PS5 — AlphaSignal
  6. Concejos — r/LocalLLM
  7. Built an AI influencer setup, now drowning in tools and slow results. What’s actually working for you? — r/AI_Agents
  8. Is there any way to add a Seed Variance Enhancer for Qwen 2.1 ? In ComfyUI, it throws an error when I connect it to the "text encode qwen image 2.1" node — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →