AINewsnow

Whisper on the RK3588 NPU: the encoder offload works — everything around it is the real lesson

Status: encoder offload merged into a working whisper.cpp path on an RK3588 board, transcription byte-identical to the CPU reference, PR filed upstream (ggml-org/whisper.cpp#4159). This post is the full map — the win, the two dead ends, and the tooling traps — because the dead ends are the part nob…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-09 00:26 · DEV Community — Machine Learning
    Whisper on the RK3588 NPU: the encoder offload works — everything around it is the real lesson

More stories

  1. How is Claude voice to text so good? — r/ClaudeAI
  2. Local Streaming ASR: Speed vs Stability? — r/LocalLLM
  3. I built a WhatsApp voice message translator with Expo, Whisper and Google TTS (as a solo dev) — DEV Community — AI
  4. Video link to text for Bilibili, Douyin and RedNote: 4 approaches compared (download + Whisper, subtitles, editors, a link API) — DEV Community — AI
  5. Tried the weight editing thing from the MIT post: Some cool applications, but nothing crazy — r/LocalLLaMA
  6. I spent a week testing whether LLMs can really "program weights." Reading weights: yes. Self-improvement: no. 20 steps of fine-tuning erase the edit — r/singularity
  7. How to Run Qwen3-ASR on Your Android Phone in 2026 (Offline Speech to Text in 30 Languages) — DEV Community — AI
  8. Otter.ai vs Whisper: Which Is Better in 2026? — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →