Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090
llama.cpp merged PR #29887 two weeks ago and I think it is the most interesting thing to land in local inference this year, so I went through the PR, the benchmarks and the review thread and wrote up how it actually works. Short version below, long version linked at the end. The problem Qwen3.8-Fla…
Read the full story at r/ArtificialInteligence ↗
Timeline · 5 reports
- 2026-10-23 15:08 · DEV Community — Machine Learning
Muse Spark Open: Meta's 816B Open-Weight Model, Explained - 2026-10-23 09:02 · r/LocalLLM
Tested: Qwen3.8-Flash-Next Q6 vs NVFP4 on my RTX 5090 using Strata — is the Q6 worth the extra memory ? - 2026-10-22 20:14 · r/LocalLLaMA
Meta's 816B Muse Spark Open scores 39 on Artificial Analysis, the 180B Qwen3.8-Flash-Next scores 40. Score vs size for 11 open-weight models - 2026-10-21 18:11 · r/artificial
Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090 - 2026-10-21 18:11 · r/ArtificialInteligence
Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090