Making XDNA2 NPU less useless
Hello there, I was disappointed with AMDs implementation of the XDNA2 for local LLMs. I therefore tried to treat the XDNA2 NPU as just another backend that should universally support any model (kinda like a GPU). I got fairly good performance but it is not perfect. If you want to try it here it is:…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-21 08:20 · r/LocalLLM
Making XDNA2 NPU less useless