AINewsnow

Follow-up: decision models vs. local LLMs — I counted the tokens and the bill. The gap is all output tokens.

Yesterday I posted that Qwen3.5-9B beat all 14 "decision models" (Solar Decide, Microsoft-Decision-1, Jev…) on our 56 triage tasks. One reply made a fair point: decision models never claimed to be smarter, their pitch is efficiency. So how much does the extra accuracy cost? I logged input tokens, o…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-12 12:31 · r/LocalLLM
    Follow-up: decision models vs. local LLMs — I counted the tokens and the bill. The gap is all output tokens.

More stories

  1. Saving tokens and cost by using Jev in Jinja templated Skills — r/AI_Agents
  2. Fine-tuned two small decision models on my own server logs, locally on a Mac Studio. On par with Jev (for my specific use). — r/LocalLLM
  3. LLMs vs traditional classifiers for large scale data processing — r/artificial
  4. Workday is using TypeSafe's Jev to build user interfaces on the fly — The New Stack AI
  5. A label-redefinition suffix moved our security classifier more than a length-matched neutral sentence — r/PromptEngineering
  6. Adding a benign shell action changed our content-injection score from 0.00 to 0.96 — r/deeplearning
  7. Our security model scored 98–100% on action checks in validation. A few hand-written scenes exposed the gap. — r/learnmachinelearning
  8. Decision Systems, eDiscovery, Litigaze + More — Artificial Lawyer

Get the daily brief of stories like this at 6:30 every morning →