50B+ MoEs with few active parameters, what's the sweet spot for intelligence, agent speed, and affordable fine-tuning?
I’m building a Polish General purpose legal Model that drafts documents, answers questions using legal sources, and has enough coding ability to handle some automation. The workflow is very tool-heavy: Question → many sequential tool calls → final answer/document Think Claude Code/Codex-style execu…
Read the full story at r/MLQuestions ↗
Timeline · 2 reports
- 2026-09-29 09:57 · r/LocalLLaMA
50B+ MoEs with few active parameters, what's the sweet spot for intelligence, agent speed, and affordable fine-tuning? - 2026-09-29 09:57 · r/MLQuestions
50B+ MoEs with few active parameters, what's the sweet spot for intelligence, agent speed, and affordable fine-tuning?