AINewsnow

PSA: Upgrade Flash Next to DFlash2 if you haven't! +17% on average

Not long ago, DFlash2 for Qwen3.8-Flash-Next was released, but initially llama.cpp compatibility wasn't there. Now it is. I quantized my own GGUFs of the drafter and tested it out in llama.cpp v0.8.0, the first release that supports DFlash2 for FN. Speed: MTP (acceptance) DFlash2 (acceptance) delta…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-30 17:19 · r/LocalLLaMA
    PSA: Upgrade Flash Next to DFlash2 if you haven't! +17% on average

More stories

  1. Run TeleAI's Xing4.0-29B-A4B GGUF via ik_llama.cpp — Full native mHC/MLA runtime + HF converter — r/LocalLLM
  2. I dpo post-trained llama-3.1-8b to be 100% more robust against jailbreaks (and measured what it costs) — r/huggingface
  3. Janas: a C inference engine that runs MoE models bigger than your RAM by streaming experts from NVMe, plus an almost complete OpenAI-compatible server, MCP tools, vision and speech (GPL-3.0) — r/LocalLLM
  4. I spent a year making old Tesla P100/V100 cards fast for local LLMs. PXA 4.0 is out today: up to 3x the decode and 8x the prompt speed of mainline llama.cpp on the same box, same files. Numbers, method and the losses inside. — r/LocalLLM
  5. Arc Pro B60 on WSL2 (Vulkan via Mesa Dozen) is 8 to 40 times slower than native Windows Vulkan, and Qwen3.8-27B segfaults inside Intel's LLVM. Anyone seen this? — r/LocalLLM
  6. Why does my local LLM keep reverting to generic prose despite extensive author-style examples and prompt engineering? Am I overengineering this? — r/LocalLLM
  7. Which coding agent gets the most out of a local Qwen 3.8 27B? I lined up 10 and logged tokens, cache and sandbox blocks — r/AI_Agents
  8. I tested a 12B open-source AI Humanizer locally. Here's what I found. — r/learnmachinelearning

Get the daily brief of stories like this at 6:30 every morning →