Kairos: Toward a Byte-Level Foundation Model for Every Modality
arXiv:2610.12495v1 Announce Type: new Abstract: Small language models trained on a single local machine leave little room for architectural trial and error. Kairos combines bidirectional gated-DeltaNet linear attention and sliding-window attention over shared projections (LiZAttention2), block-wise…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-12 04:00 · arXiv cs.LG
Kairos: Toward a Byte-Level Foundation Model for Every Modality