PSSA, a plastic state space model, beats a parameter-matched transformer on held-out text and generates ~12x faster on CPU
This story is from 2026-09-29. It is preserved in the archive; the latest stories are on the live feed.
I built a from-scratch architecture called PSSA (plastic state space architecture) and trained it against a parameter-matched transformer baseline on the same corpus, same 12.7M tokens, same tokenizer and schedule. Held-out results on a 198,939-token slice neither run saw: cross-entropy 3.997 vs 4.…
Read the full story at r/artificial ↗
Timeline · 1 report
- 2026-09-29 23:31 · r/artificial
PSSA, a plastic state space model, beats a parameter-matched transformer on held-out text and generates ~12x faster on CPU