AINewsnow

Statistical tie with Jev on BANKING77 (91.79% vs 92.40%, p=0.27) at ~1/1000 the cost

We scored a Tuatara Vector Model blend against Jev's published answers on all 3,080 BANKING77 test messages: 91.79% versus 92.40%, a statistical tie with substantial cost savings. BANKING77 is a public dataset from PolyAI: 13,083 real customer messages to a bank, each labelled with one of 77 intent…

Read the full story at r/learnmachinelearning ↗

Timeline · 1 report

  1. 2026-09-27 06:53 · r/learnmachinelearning
    Statistical tie with Jev on BANKING77 (91.79% vs 92.40%, p=0.27) at ~1/1000 the cost

More stories

  1. Mica v0.1 4B: open Jev-style decision model (yes/no, choice, score) that runs on an 8 GB GPU — trained for under $30 of GPU time — r/LocalLLM
  2. Fastino Releases GLiNER2.5-Decide: A 340M Open-Weight Decision Model That Runs on CPU — MarkTechPost
  3. Turning GLM-5.3-Flash into a Jev-like decision model — Hacker News Front Page
  4. Jev vs. Kev: open-source Jev alternative tested side by side — r/LocalLLaMA
  5. How JEV works internally — r/learnmachinelearning
  6. New frontier AI models, TypeSafe’s Jev AI, & NASA’s IBM collab — Mixture of Experts (IBM)
  7. The cheap new AI model taking aim at OpenAI and Anthropic — Financial Times AI
  8. I built an open-weight alternative to Jev / TypeSafe - introducing OpenJudgement-4B (early preview) — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →