Dory1.0-4B: A Looped Normalized-GPT
arXiv:2611.03998v1 Announce Type: new Abstract: We introduce Dory1.0-4B, a 4-billion-parameter looped (latent-recurrent) language model with elastic depth: a single checkpoint serves different inference compute budgets. Dory1.0-4B is built on a normalized Transformer (nGPT) backbone with interleave…
Read the full story at arXiv cs.CL ↗
Timeline · 1 report
- 2026-11-04 05:00 · arXiv cs.CL
Dory1.0-4B: A Looped Normalized-GPT