AINewsnow

Mica v0.5: The smartest 4B decision model is also the fastest one. 20 ms per answer, 25x faster than Jev

I'm sharing Mica v0.5, the follow-up to Mica v0.1. It's 4B and runs on one consumer GPU. On speed, it takes 19.8 ms per decision at 256 tokens and about 1.2 s at 32k on a single RTX 6000 Ada. That's up to 3.8x faster than the other 4B judges I measured, 12 to 19x faster than Perplexity's 27B decide…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-21 19:00 · r/LocalLLaMA
    Mica v0.5: The smartest 4B decision model is also the fastest one. 20 ms per answer, 25x faster than Jev
  2. 2026-10-21 18:58 · r/LocalLLM
    Mica v0.5: The smartest 4B decision model is also the fastest one. 20 ms per answer, 25x faster than Jev

More stories

  1. ⚖️ Forecast Court Is Open: Every AI Trading Model Defends Its Predictions — Jev Takes the Jury Seat — DEV Community — Machine Learning
  2. Do you actually use voice with ChatGPT or Codex for serious work? — r/ChatGPTPro
  3. A former ChatGPT researcher says better chatbots won’t get us to AGI. His alternative doesn’t generate text at all. — r/agi
  4. The Sequence Learning Loop - Issue #955: From Persistent Agents to Decision Models — TheSequence
  5. The costs of “decisions” has dropped 10x in just a few months — r/LocalLLaMA
  6. Play around with Jev as a chatbot — r/PromptEngineering
  7. Jev Based Adaptive Thinking for LLMs — r/LocalLLaMA
  8. I built an app to efficiently run decision models on the Apple Neural Engine with Shortcuts actions for OS automations — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →