Upgraded from RX 9070 XT (16GB, ROCm) to RTX 5090 (32GB, CUDA) on CachyOS Linux — 236 tok/s Decode & 6,272 tok/s Prefill on Qwen3.8-Flash-Next (IQ3_S) in Strata
I just upgraded my local AI & gaming rig from an AMD Radeon RX 9070 XT (16 GB) to an NVIDIA GeForce RTX 5090 (32 GB) on CachyOS Linux (without reinstalling the OS). Before pulling out the AMD card, I wrote a custom Python benchmark harness (`strata-bench.py`) to record exact baseline numbers across…
Read the full story at r/LocalLLM ↗
Timeline · 2 reports
- 2026-10-31 01:09 · r/LocalLLaMA
Qwen3.8-Flash-Next on 2x RTX 5090 with 504 tok/s decode: QEngine 1.3.1 decodes ~1.5-1.9x faster than the next-best engine I've tried (numbers, caveats, and what still bites) - 2026-10-29 18:33 · r/LocalLLM
Upgraded from RX 9070 XT (16GB, ROCm) to RTX 5090 (32GB, CUDA) on CachyOS Linux — 236 tok/s Decode & 6,272 tok/s Prefill on Qwen3.8-Flash-Next (IQ3_S) in Strata