Did we hit a wall in context length?
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
I feel like midel context size rapidly went from 8k to 1M in just a few years but has since stayed this way for a while now. Some still offerring 260k or 400k for their flagship models. Is it just not worth the trouble? I feel like highly capable models are limited by this in that they can't finish…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-16 11:41 · r/LocalLLaMA
Did we hit a wall in context length?