AINewsnow

The irony of jev/decision models...

... is that LLM's going all the way back to Llama 2 can do this with constrained sampling. And the only reason people are hyped about it now is because test time compute/the zero shot chain of thought hack that inspired "reasoning" models has become so ubiquitous that models are all cripplingly slo…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-23 16:44 · r/LocalLLM
    The irony of jev/decision models...

More stories

  1. The Sequence Learning Loop - Issue #955: From Persistent Agents to Decision Models — TheSequence
  2. OpenAI makes its Jev competitor widely available as decision model competition heats up — TechCrunch AI
  3. KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021 — r/LocalLLaMA
  4. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  5. Text Moderation Choices: JSON Schema, Portability, and Integration Friction — DEV Community — AI
  6. Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090 — r/ArtificialInteligence
  7. A 4B model faster than a 395M encoder? 14 ms vs 31 ms (2.2x). Another 4B model: 150 ms (10x slower) — r/LocalLLaMA
  8. Offline manga translation on Android: bubble detection + OCR + a local LLM on llama.cpp, ~15 s/page on a Galaxy S23 (open source) — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →