Got jev-like api running natively on ninfer / qwen3.8 27b and results are quite decent
Hi all! After all the jev hype I wanted to try by myself and got qwen3.8 27b to mix-and-match open implementations on top of ninfer, and to be honest I'm quite impressed with the results, latency is not great but accuracy is almost on par, this is a very dirty POC but it kinda works (there's still…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-21 14:46 · r/LocalLLaMA
Got jev-like api running natively on ninfer / qwen3.8 27b and results are quite decent