For the longest time I’ve felt this sub should have a pinned section where a detailed post about each model should get featured.
For instance whenever a model comes out, what’s the best engine to run it, the best harness and absolute minimum you need to get same or near same re results that the benchmark of that model claims. And whenever a quant from Unsloth guys comes out the guide can either be updated or new guide could…
Read the full story at r/LocalLLaMA ↗