An all-transistor physical-learning transformer can be trained to perform in-context learning
arXiv:2610.12571v1 Announce Type: new Abstract: Most systems trained by equilibrium propagation or coupled learning are in the same class as multi-layer perceptrons: while they may be universal function approximators, they struggle to learn associative tasks which are easy for transformers. Equilib…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-10-12 04:00 · arXiv cs.LG
An all-transistor physical-learning transformer can be trained to perform in-context learning