Amazing free 3090 speedup hack, verified works 15% PP, 5% TG for free
I saw this today on X and decided to try it, I havent seen it posted here yet. I ran it on a single 3090 benchmarked it with qwen 3.8 27B before and after the optimization and saw these results: Observed prompt-processing throughput improved 22–30% ; generation speed improved 1–5% . All tests passe…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-21 18:19 · r/LocalLLaMA
Amazing free 3090 speedup hack, verified works 15% PP, 5% TG for free