NIRNAY: a 450M open model that beats Jev
NIRNAY phase_b scores 0.8792 on the full Banking77 test set (3,080 cases). Jev 1.13.0 scores 0.803 on the same cases (jevbench.xyz recorded run). Ours runs local in ~200ms, no API key, Apache-2.0. The caveat up front, because it matters: we fine-tuned on the train split, Jev answered zero-shot. Sam…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-01 06:59 · DEV Community — Machine Learning
NIRNAY: a 450M open model that beats Jev