AINewsnow

Mica v0.5: The smartest 4B decision model is also the fastest one. 20 ms per answer, 25x faster than Jev

This story is from 2026-10-21. It is preserved in the archive; the latest stories are on the live feed.

I'm sharing Mica v0.5, the follow-up to Mica v0.1. It's 4B and runs on one consumer GPU. On speed, it takes 19.8 ms per decision at 256 tokens and about 1.2 s at 32k on a single RTX 6000 Ada. That's up to 3.8x faster than the other 4B judges I measured, 12 to 19x faster than Perplexity's 27B decide…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-21 19:00 · r/LocalLLaMA
    Mica v0.5: The smartest 4B decision model is also the fastest one. 20 ms per answer, 25x faster than Jev

More stories

  1. Mica v0.5: The smartest 4B decision model is also the fastest one. 20 ms per answer, 25x faster than Jev — r/LocalLLM
  2. ⚖️ Forecast Court Is Open: Every AI Trading Model Defends Its Predictions — Jev Takes the Jury Seat — DEV Community — Machine Learning
  3. Do you actually use voice with ChatGPT or Codex for serious work? — r/ChatGPTPro
  4. A former ChatGPT researcher says better chatbots won’t get us to AGI. His alternative doesn’t generate text at all. — r/agi
  5. The Sequence Learning Loop - Issue #955: From Persistent Agents to Decision Models — TheSequence
  6. The costs of “decisions” has dropped 10x in just a few months — r/LocalLLaMA
  7. Play around with Jev as a chatbot — r/PromptEngineering
  8. Jev Based Adaptive Thinking for LLMs — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →