Mamba2-8B compression research series: 27.18 MiB recurrent cache or 3.141 GB stored model data
Author disclosure: these are my independent projects. I'm sharing two Mamba2-8B research releases exploring different compression tradeoffs, each with a trained Resurface-style recall adapter. These are separate configurations; their memory numbers should not be combined. SQ3.25 recurrent-state com…
Read the full story at r/huggingface ↗
Timeline · 1 report
- 2026-10-15 23:10 · r/huggingface
Mamba2-8B compression research series: 27.18 MiB recurrent cache or 3.141 GB stored model data