Highly optimized Strata port for 7900xtx 24GB
This story is from 2026-11-05. It is preserved in the archive; the latest stories are on the live feed.
Repo here: https://github.com/nicejunjie/Strata-rdna3 * Single 7900xtx prefill 3500+, dual 7000+ tok/s. (for all IQ3/IQ4/Q4) * Decode for English prose reaches up to 81 tok/s for single card, and 127 for dual at Q4, and IQ4/IQ3 quantizations are even faster. * Decode for python coding is 20~25% fas…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-05 06:43 · r/LocalLLM
Highly optimized Strata port for 7900xtx 24GB