AINewsnow

More stories

  1. Transformers now runs llama.cpp quants — Hugging Face Blog
  2. yandex/AliceAI-Foundation-80B-A3B-Base: Russian-developed competitor to Qwen 35B and DeepSeek V4 Flash — r/LocalLLaMA
  3. I trained a 360M-param Python model from scratch on two workstation GPUs and wrote up every step, including the bugs — r/learnmachinelearning
  4. 25 LLM architecture blocks, side by side, in runnable PyTorch — DEV Community — Machine Learning
  5. This Week in AI Dev: Frontier Prices Halved and a 27B Model Fit in 6GB (Week 39 of 2026) — DEV Community — Machine Learning
  6. I turned Qwen3.8-27B Q2_64 + llama.cpp into a fully TypeSafe AI-compatible Jev-like system. OpenAI API still intact! World’s first Vision-enabled Jev-like model! <10 GB VRAM, 170 ms on an RTX 3090 and ~140 tok/s in chat. 76% vs. 88% Jev-1.13 Acc. on a diverse 22,000-request typed-decision benchmark — r/LocalLLaMA
  7. GGUFs in transformers natively! — r/LocalLLaMA
  8. 2× Tesla P100 (2016 cards) in 2026: 110 tok/s on a 30B MoE, 16 tok/s at 1M context — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →