AINewsnow

Enabling phone local control with Big LLMs thanks to NPU prefill (100+ tok/s) and Jev style decisions

Stack – Local Model – No Cloud for full phone control via typing/(voice coming soon): Android phone with 12 GB RAM, Qualcomm Hexagon NPU (OnePlus 15R used in the video) BigMoeOnEdge open-source project: latest commits feature NPU prefill support and "Jev Style" ranked response implementation (with…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-28 13:31 · r/LocalLLM
    Enabling phone local control with Big LLMs thanks to NPU prefill (100+ tok/s) and Jev style decisions

More stories

  1. OpenDecider: distilling calibrated "System One" decision models from open teachers, evaluated head-to-head against Laya and TypeSafe's Jev — r/machinelearningnews
  2. TensorSharp Jev requests can now combine documents, images, video, and audio — r/LocalLLM
  3. Jev vs. Kev: open-source Jev alternative tested side by side — r/LocalLLaMA
  4. How JEV works internally — r/learnmachinelearning
  5. New frontier AI models, TypeSafe’s Jev AI, & NASA’s IBM collab — Mixture of Experts (IBM)
  6. How long until OpenAI release their version of Jev? — r/AI_Agents
  7. Supersonic Labs Releases Julia 1: A 144.3M-Parameter Open Decision Model That Runs on a CPU — MarkTechPost
  8. A DIY Jev: typed decisions from gpt-6-luna logprobs, benchmarked head-to-head — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →