Transformers as Cross-Task Learners: Shared Structure Drives Sample Efficiency in In-Context Learning
arXiv:2609.29060v1 Announce Type: new Abstract: Transformers achieve remarkable performance by jointly learning broad families of tasks during pretraining and adapting to unseen tasks from only a short prompt. Yet a rigorous mathematical and statistical understanding of this phenomenon remains limi…
Read the full story at arXiv stat.ML ↗
Timeline · 1 report
- 2026-09-25 04:00 · arXiv stat.ML
Transformers as Cross-Task Learners: Shared Structure Drives Sample Efficiency in In-Context Learning