Do looped transformers save HBM traffic? Profiling weight reuse in Huginn on a B200 [P]
Do looped transformers, which reuse the same weights at every iteration, also save HBM traffic? In my new post I cover the looped architecture (Huginn), then model and measure its performance on a B200: how much data each iteration reads from memory, how long it takes, and why the shared weights us…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-11-04 16:26 · r/MachineLearning
Do looped transformers save HBM traffic? Profiling weight reuse in Huginn on a B200 [P]