Recurrent Looped Transformer
arXiv:2610.07591v1 Announce Type: new Abstract: State tracking requires an update at every input, but the depth a Transformer applies to each token is fixed regardless of sequence length. We introduce the Recurrent Looped Transformer (RLT), which splits its layers between a parallel causal encoder…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-10-07 04:00 · arXiv cs.CL
Recurrent Looped Transformer