The minimum size of an LLM to generate a little meaningful convo
I am trying to find the smallest model to generate something in "normal" English, it could be like AI generated, but it should be mostly grammar correct, sensible in the context. I hope it could be less than 10M to be easy for CPU, so I tested some like Supra-Mini-v6-1M. well it's not good enough.…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-25 15:09 · r/LocalLLaMA
The minimum size of an LLM to generate a little meaningful convo