Small models are actually quite capable when the input is structured right...
This story is from 2026-10-02. It is preserved in the archive; the latest stories are on the live feed.
We decided to run some small models, up to 3 billion parameters, on an old Note 8 (llama.cpp in Termux). We gave them what looked like a simple task: on the Wikipedia page for the Galaxy Note series, pick the "Note 8" link among similar ones ("Note 8.0", "Galaxy Note 8.0", "Note FE") and read the r…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-02 10:39 · r/LocalLLM
Small models are actually quite capable when the input is structured right...