AINewsnow

Six Graphs Out of Nine: InternVL3.5-2B on QCS6490, and the FP32 Tensor Hiding in the Vendor's Own Asset

Six Graphs Out of Nine: InternVL3.5-2B on QCS6490, and the FP32 Tensor Hiding in the Vendor's Own Asset After two LLMs went through the manual export chain on the Qualcomm QCS6490 (Dragonwing RB3 Gen 2) — Qwen3-0.6B at 1,555 tok/s prefill, Llama 3.2 1B at 1,024 — the obvious next step was a vision-…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-16 04:26 · DEV Community — Machine Learning
    Six Graphs Out of Nine: InternVL3.5-2B on QCS6490, and the FP32 Tensor Hiding in the Vendor's Own Asset

More stories

  1. OpenAI fine-tuning vs open models: which costs less? — DEV Community — Machine Learning
  2. AI Daily Digest · November 14, 2026: NVIDIA Loses Its Founder-CEO, ChatGPT Gets a Wallet, llama.cpp Hits 1.0 — DEV Community — AI
  3. Kindi – fast local inference on low-cost GPUs, and the exact-match rule that makes its numbers trustworthy — DEV Community — Machine Learning
  4. Show HN: 53ON AI Server – OpenAI-compatible server for AMD Ryzen AI Max — DEV Community — AI
  5. I have created a tool to observe what happens inside an LLM. Also allows for the comparison of two quantizations of the same model to see at what point they diverge, token by token — r/LocalLLaMA
  6. Llama.cpp performance improvement over time (Gemma4 models) — r/LocalLLaMA
  7. BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model — r/LocalLLaMA
  8. llama.cpp was copying 643 MB to the CPU per request. Disabling state saving nearly doubled throughput — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →