PXA v3.1: Qwen3.8 Flash-Next at 31 t/s on a single Tesla P100, 55 t/s on two V100s (open source, beats Strata on prose + prefill)
https://preview.redd.it/smmxfg9d4ruh1.jpg?width=1800&format=pjpg&auto=webp&s=28b2129c598488c90cad948d6bf0fe0b472390ba https://preview.redd.it/4qnolw5c4ruh1.png?width=1695&format=png&auto=webp&s=cf5872bafa4b40339d13ab2817ab70b2b1779ed2 I'm the dev of PXA, an open-source inference engine built for ol…
Read the full story at r/LocalLLM ↗