AINewsnow

More stories

  1. DeepSeek V4.1 Flash 1017 now available on AI Gateway — Vercel Blog
  2. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
  3. Liquid AI's LFM2.5-24B Runs 184 Tokens per Second for Local Agents — AlphaSignal
  4. Qwen Ships Qwen3-VL 8B Locally, Seeing Images and Video in 5 GB — AlphaSignal
  5. Round 3: Tested 128K context on a 3090 with real code (Django) and a novel. Finding one thing is solid, counting is hopeless — r/LocalLLM
  6. Efforts to upstream adaptive MTP depth to llama.cpp abandoned — r/LocalLLM
  7. New quant types suggested: IQ2_K, IQ3_K, IQ4_K, IQ5_K and IQ6_K — r/LocalLLaMA
  8. Has anyone used EXO in x86 machines, or am I just better off using llama.cpp or dllama? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →