Ornith 1.5 35B-A3B with Ninfer on 5090 - 500 tok/s+, 256k context - am I in love?
This story is from 2026-08-31. It is preserved in the archive; the latest stories are on the live feed.
Ornith 1.5 just seems incredible to me for an A3B, worlds better than other MoE's I've tried, and works so fast with Ninfer on a 5090. Really none of this is my work at all - built on Ninfer, Ornith and Shisa AI - the re-packaging was a prompt basically and then some testing. I'm sharing in the hop…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-08-31 09:59 · r/LocalLLM
Ornith 1.5 35B-A3B with Ninfer on 5090 - 500 tok/s+, 256k context - am I in love?