AINewsnow

FeatherAttn: Attention backward kernel on Strix Halo, 4x fast as FlashAttn

https://github.com/woct0rdho/feather-attn On RDNA3/3.5 GPUs, FlashAttn wires to Triton kernels in AITER (AMD's kernel collection). The fwd kernel is fast enough, but it seems no one has optimized the bwd kernel. I've made a bwd kernel with a better designed pipeline. When tested on Strix Halo, it's…

Read the full story at r/StableDiffusion ↗

Timeline · 1 report

  1. 2026-10-30 18:20 · r/StableDiffusion
    FeatherAttn: Attention backward kernel on Strix Halo, 4x fast as FlashAttn

More stories

  1. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  2. Gemini 4 Carbon: Our next frontier model — Google DeepMind Blog
  3. Cursor says up to 5,000 users affected by tampered Claude Code extension — Reuters AI
  4. Sam Altman says it’s better for RAM to be in a data center than on your desk — The Verge AI
  5. Apple Intelligence is finally coming to China with iOS 27.3 — The Verge AI
  6. Finnish police launch criminal probe over forest cleared for Google data center — The Hill Technology
  7. Intel stock has worst day since 1970s, wiping about $12 billion off government's stake — CNBC Technology
  8. Community safety report and new protections for teens — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →