[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)
This story is from 2026-10-13. It is preserved in the archive; the latest stories are on the live feed.
ALHR- Adaptive learnable Hierarchical Routing is a static binary tree based system that uses learnable functions to REDUCE the amount of keys used. It takes less memory and SCALES much better VRAM with tokens I’ve also been testing tiny stories and it looks promising However i can’t post any presen…
Read the full story at r/machinelearningnews ↗
Timeline · 3 reports
- 2026-10-13 11:54 · r/deeplearning
[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR) - 2026-10-13 11:53 · r/learnmachinelearning
[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR) - 2026-10-13 11:50 · r/machinelearningnews
[UPDATE] I Built a O(NlogN) attention system that retains 97% accuracy over long context (MQAR)