Do we really need all these "speed" posts?
I appreciate the research and development that is going into these open source tools. However, there appears to be multiple posts on a daily basis about reaching 300 t/s, and then reading into it: Running on Q1_XXXS REAP quant Greedy decoding TAIL_SKIP (I only have 5GB RAM, but if the API ignores a…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-02 00:52 · r/LocalLLaMA
Do we really need all these "speed" posts?