Six Graphs Out of Nine: InternVL3.5-2B on QCS6490, and the FP32 Tensor Hiding in the Vendor's Own Asset
Six Graphs Out of Nine: InternVL3.5-2B on QCS6490, and the FP32 Tensor Hiding in the Vendor's Own Asset After two LLMs went through the manual export chain on the Qualcomm QCS6490 (Dragonwing RB3 Gen 2) — Qwen3-0.6B at 1,555 tok/s prefill, Llama 3.2 1B at 1,024 — the obvious next step was a vision-…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-11-16 04:26 · DEV Community — Machine Learning
Six Graphs Out of Nine: InternVL3.5-2B on QCS6490, and the FP32 Tensor Hiding in the Vendor's Own Asset
More stories
- OpenAI fine-tuning vs open models: which costs less? — DEV Community — Machine Learning
- AI Daily Digest · November 14, 2026: NVIDIA Loses Its Founder-CEO, ChatGPT Gets a Wallet, llama.cpp Hits 1.0 — DEV Community — AI
- Kindi – fast local inference on low-cost GPUs, and the exact-match rule that makes its numbers trustworthy — DEV Community — Machine Learning
- Show HN: 53ON AI Server – OpenAI-compatible server for AMD Ryzen AI Max — DEV Community — AI
- I have created a tool to observe what happens inside an LLM. Also allows for the comparison of two quantizations of the same model to see at what point they diverge, token by token — r/LocalLLaMA
- Llama.cpp performance improvement over time (Gemma4 models) — r/LocalLLaMA
- BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model — r/LocalLLaMA
- llama.cpp was copying 643 MB to the CPU per request. Disabling state saving nearly doubled throughput — r/LocalLLM
Get the daily brief of stories like this at 6:30 every morning →