Qwen 3.8 27B 256K context - how is that possible?

Running 256k prompt testing qwen 3.8 splash on my MacBook with only 36G ram, binned m4 max chip. Filling speed about 100tps generation speed 15tps. How could that even be possible without significant amount of swap??

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-15 14:45 · r/LocalLLM
Qwen 3.8 27B 256K context - how is that possible?

More stories

Qwen 3.8 Flash Next gains traction with optimized local inference engines — r/LocalLLaMA
Alibaba launches Qwen N1 AI glasses with 50MP cameras and swappable batteries — Mint AI
Fortytwo Launches Engine API, Reporting 24.7% Fewer Tokens on Coding Tasks — Unite.AI
MBZUAI Ships Jais 3, Six Open Arabic Models Beating Qwen and Claude — AlphaSignal
Apple reportedly plans December China launch for Apple Intelligence using Alibaba models — TechNode
Western and Chinese AI search engines cite largely separate webs. Qwen's sources were 96% Chinese even with half the questions in English — r/artificial
Diffusion without CFG? Correction Training for Diffusion Models — r/StableDiffusion
Is anyone working on improving prefill speed? (Qwen 27b, Flash) — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →