How long does it take for a new architecture breakthrough/innovation to make its way to a released model?
Suppose today Qwen discovered a really efficient way to store KV Cache and context length which uses drastically less VRAM. By now, its too late to put it into Qwen 4 or Qwen 4.5 since they are already training. Will we see it in Qwen 5 in 2028 then? Or could there be a chance that if its a big eno…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-22 17:20 · r/LocalLLaMA
How long does it take for a new architecture breakthrough/innovation to make its way to a released model?