6gb of vram? Ornith 1.5 9b seems pretty good for a fine-tune
This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.
I spent this evening testing Ornith 1.5 9b at Q4_K_M on my RTX 3050 6gb because I'm poor / a masochist, and I have to say this is the first model I trust enough to run as a local assistant on such crappy hardware. Using Pi Agent, it was able to run about 85% of its 128k context window without devol…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-08-21 07:18 · r/LocalLLM
6gb of vram? Ornith 1.5 9b seems pretty good for a fine-tune