We built the AIM System One Index, a leaderboard for decision models (57 models ranked on accuracy, bias, cost and latency)

We’ve been testing “System One” models, also called decision models. Instead of generating text token by token, they return a typed decision with a probability for each option in a single pass. To compare them, we put together the AIM System One Index. It combines three benchmarks: Browser tasks: 5…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

1. 2026-10-20 23:08 · r/LocalLLM
   We built the AIM System One Index, a leaderboard for decision models (57 models ranked on accuracy, bias, cost and latency)