Write the reference before debugging the shader
This story is from 2026-09-15. It is preserved in the archive; the latest stories are on the live feed.
The Flash Attention 2 path was easier to finish after the algorithm existed in plain JavaScript first. The forward pass used one workgroup per batch, head, and query tile. It walked keys and values in blocks while keeping the online-softmax state in registers. The backward pass recomputed attention…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-09-15 04:30 · DEV Community — Machine Learning
Write the reference before debugging the shader