Interested on your Ideas on how a relatively small model MOE <12B could use a classifiers like the Jev inside.
Hi Amigos, I have been wondering what technology could give the big jump in speed and resource usage to "small models" under 12B parameters. This is what matters in the end of the day to optimise the knowledge we already have, if it is so good let's make it cheaper and more accessible to everyone.…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-26 22:29 · r/LocalLLM
Interested on your Ideas on how a relatively small model MOE <12B could use a classifiers like the Jev inside.