Periscope: Extending Frozen Language Models Beyond Their Context Window
arXiv:2610.04047v1 Announce Type: new Abstract: A language model reads long text in one quadratic forward pass, stops at the context window, and loses accuracy with length before reaching it. We ask whether the read can be factorized when deciding over a finite set: which document is relevant, whic…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-06 04:00 · arXiv cs.CL
Periscope: Extending Frozen Language Models Beyond Their Context Window