LSTM-UT and Recurrent-Depth Transformers on Cellular Automata
This story is from 2026-09-18. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.19521v1 Announce Type: new Abstract: Recurrent-depth Transformers apply shared computation repeatedly, but differ in how they retain information across steps. We compare a Block Universal Transformer (BUT), which carries only its current hidden state; CoTFormer, which also retains an exp…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-18 04:00 · arXiv cs.LG
LSTM-UT and Recurrent-Depth Transformers on Cellular Automata