One thing that I do not about AI, aren't modern day LLMS limited by their context window and weights?
These models have essentially fixed weights, a limited context window which when exhausted is like a completely new persona. They cannot change their weights. There does not exist "continual learning" as of now so no new information can't be fed in without using some percentage of the context windo…
Read the full story at r/ArtificialInteligence ↗
Timeline · 1 report
- 2026-09-20 18:27 · r/ArtificialInteligence
One thing that I do not about AI, aren't modern day LLMS limited by their context window and weights?