transformer with shared product-key memory instead of FFNs ties a MoE at 23M params (negative result + open reasoning benchmark)
Coverage of "transformer with shared product-key memory instead of FFNs ties a MoE at 23M params (negative result + open reasoning benchmark)" from 1 source, with a live timeline of who reported what and when.
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-21 06:28 · r/deeplearning
transformer with shared product-key memory instead of FFNs ties a MoE at 23M params (negative result + open reasoning benchmark)