AINewsnow

NIRNAY: a 450M open model that beats Jev

This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.

NIRNAY phase_b scores 0.8792 on the full Banking77 test set (3,080 cases). Jev 1.13.0 scores 0.803 on the same cases (jevbench.xyz recorded run). Ours runs local in ~200ms, no API key, Apache-2.0. The caveat up front, because it matters: we fine-tuned on the train split, Jev answered zero-shot. Sam…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-01 06:59 · DEV Community — Machine Learning
    NIRNAY: a 450M open model that beats Jev

More stories

  1. Marimba: a System One model for speech [R] — r/MachineLearning
  2. Zombies, a Gunship and a Judgment Model: What Could Go Wrong? — DEV Community — AI
  3. Open-source chat assistant - cross-platform reply drafter — DEV Community — AI
  4. Tutorial Walks Through Four Python Examples of Image-Based Decision Making — Towards Data Science
  5. Free Open-Source Alternatives to Jev Highlighted for Local Use — KDnuggets
  6. Study Examines Whether Decision Models Can Serve as Multilingual Judges — arXiv cs.CL
  7. Decision models: the AI that can't ramble, and why my prompt-and-parse code wants one — DEV Community — AI
  8. Jev Creator Diogo Almeida Discusses Decision Models and Benchmark Fatigue on Podcast — Unsupervised Learning (Redpoint)

Get the daily brief of stories like this at 6:30 every morning →