AINewsnow

The official RKLLM vision demo doesn't run on the transformers it targets — a five-version bisection

I'm converting Qwen2-VL-2B-Instruct to run on a Rockchip board with Rockchip's official rknn-llm toolkit. Step one is exporting the vision tower to ONNX with the repo's own multimodal demo script. It did not run. Not on my code — on the repo's own script, with the transformers generation the repo's…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-08 22:11 · DEV Community — Machine Learning
    The official RKLLM vision demo doesn't run on the transformers it targets — a five-version bisection

More stories

  1. Nvidia opens investigation into CEO Jensen Huang's relationship with alleged Chinese spy — Axios AI+
  2. Anthropic agrees $3.4 billion deal for gas-fired generators to power AI data centres — Financial Times AI
  3. Latest Hiring Data Shows No White-Collar Job Losses From AI Yet — Wall Street Journal Technology
  4. STATERA Library publishes Korean-language series on memory and knowledge systems for LLMs — DEV Community — AI
  5. US AI Safety Center Staff Asked to Report to White House, Raising Independence Concerns — AP News
  6. Developers Document Pitfalls of Running Nightly AI Jobs on Free LLM Tiers — DEV Community — AI
  7. STATERA Library releases Volume 03 on AI reasoning in English and Korean — DEV Community — AI
  8. Developers share tools and projects built around Claude Code, Codex and Gemini CLI — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →