The workaround generalizes: Llama 3.2 1B on QCS6490 — 1,024 tok/s prefill, 16.4 tok/s decode
The workaround generalizes: Llama 3.2 1B on QCS6490 — 1,024 tok/s prefill, 16.4 tok/s decode Yesterday I published the first public GenAI numbers for Qualcomm's QCS6490: Qwen3-0.6B at 1,555 tok/s prefill and 24.6 tok/s decode. Getting there took a hand-built chain, because the official AI Hub expor…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-15 05:10 · DEV Community — Machine Learning
The workaround generalizes: Llama 3.2 1B on QCS6490 — 1,024 tok/s prefill, 16.4 tok/s decode