AINewsnow

More stories

  1. KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021 — r/LocalLLaMA
  2. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  3. Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090 — r/ArtificialInteligence
  4. A local NotebookLM that edits your files, built on llama.cpp — r/LocalLLM
  5. Flint vs Ornith vs Nemotron MoE on RTX PRO 6000, orchestrated by Opus — r/LocalLLM
  6. A TypeScript-only Qwen3.6-35B that runs at 36 tok/s on a 16 GB Mac — r/huggingface
  7. Ling-3.0-tiny-UBTree DFlash draft for stock mainline llama.cpp (+8% prose, +61% code speedup) — r/LocalLLaMA
  8. Q4 flash next for £300/600 👀 - snapdragon mini PC results update - 315/43 Tok/s A3b, 46/20 Tok/s Flash Next (read/gen) 💥 — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →