Alibaba previews Qwen4 architecture with cost-efficient MoE model
This story is from 2026-08-25. It is preserved in the archive; the latest stories are on the live feed.
Alibaba's Qwen team released Qwen3.8-Flash-Next, a 125B-parameter multimodal MoE model activating 6B per token, previewing the Qwen4 architecture. It targets 'ultimate cost efficiency' with one-ninth training cost and includes a 51B n-gram component, with memory estimates around 80-90 GB in 4-bit quant.
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-08-25 17:42 · r/LocalLLaMA
Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀