AINewsnow

More stories

  1. DeepSeek V4.1 Flash (1017) Now Leads Open-Weight Models — r/LocalLLaMA
  2. 12GB VRAM + 16GB RAM is enough for very smart local AI with 120K+ context — r/LocalLLM
  3. Qwen3-4B in 1.24 GB at perplexity 16.6 (IQ2_XXS at the same size: 28.6) - a tiny 8-state trellis quant for llama.cpp — r/LocalLLM
  4. llama.cpp support for Cohere models — r/LocalLLaMA
  5. Budget rig for local LLM inference + distillation: 2x RTX 3060 12GB vs 2x Tesla P100 16GB? — r/LocalLLM
  6. Is there an alternative to base llama.cpp for RDNA2 gpus in general with local LLM usage ? — r/LocalLLaMA
  7. llama server's default port changed from 8080 to 9931 — r/LocalLLaMA
  8. Calling all GPUs: help us benchmark SonicBoom v0.0.3 — a compiler-first AI runtime that beats llama.cpp on decode — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →