I Got Qwen3.5-9B D2-A-MTP Running on Qualcomm's snapdragon HTP — Here Are My Results
This story is from 2026-09-02. It is preserved in the archive; the latest stories are on the live feed.
gat45/htp-npu-runtime I've been testing Qwen3.5-9B D2-A-MTP GGUF inference on Qualcomm Hexagon HTP and wanted to share the results of the experiments so far. The focus has been on performance characterization, quantization, layer placement, HTP memory behavior, batching and runtime profiling . Hard…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-02 11:08 · r/LocalLLM
I Got Qwen3.5-9B D2-A-MTP Running on Qualcomm's snapdragon HTP — Here Are My Results