AINewsnow

[crosspost] Jev 1.14.0 is bluffing on the hard question

On binary questions, Jev 1.14.0 comes out calibrated, with an ECE of 0.023. That’s within what a perfectly calibrated model would show by chance on 500 questions. Broken out by difficulty, though: Easy: Jev 1.14.0 is under-confident. Its average confidence sits about 7 points below its accuracy. Me…

Read the full story at r/AI_Agents ↗

Timeline · 1 report

  1. 2026-10-15 03:55 · r/AI_Agents
    [crosspost] Jev 1.14.0 is bluffing on the hard question

More stories

  1. DecisionRobust: Benchmarking Robustness for JEV Style Decision Models Across Text and Vision — arXiv cs.CL
  2. TypeSafe AI's Jev 1.14 Brings Vision and 256K Context to Typed Decisions — AlphaSignal
  3. We’re releasing Jev 1.14.0 along with experimental features for dreamers — Hacker News Front Page
  4. Moralitybench.ai - Open benchmark testing LLMs against validated human-moral psychology instruments, updated with 3 new LLMs including Argon and Muse Wonder — r/ArtificialInteligence
  5. I trained a 15M "decision-only" model two ways — linear recurrence vs Transformer attention. Accuracy was a coin flip; latency and training cost weren't.[R] — r/MachineLearning
  6. “Take work away from frontier LLMs”: Subquadratic’s decision model claims 12x Jev’s context window — The New Stack AI
  7. Saving tokens and cost by using Jev in Jinja templated Skills — r/AI_Agents
  8. Fine-tuned two small decision models on my own server logs, locally on a Mac Studio. On par with Jev (for my specific use). — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →