Post your sessions: real-world use
We see a lot of tok/s benches, but only anecdotal evidence about performance in actual use. So, next time you're running your local model, why not ask it to print a session summary when it's done, to post here? I'd like to see what people are getting in practice for particular quant/model/finetune…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-27 07:39 · r/LocalLLM
Post your sessions: real-world use