Got Qwen3.8-Flash-Next-GSQ-RCO-IQ1_M running on 8GB VRAM + 32GB DDR4 RAM with Strata at 20t/s (100k ctx) but this is pointless and here is why
RX 6600M, Ryzen 5 5600, 32GB DDR4 RAM. This configuration of GPU-poor hardware is not supported by Strata dev, it won't even allow installing it. However, I asked my pi-agent with Tiel Coder to run it on my hardware no matter what. It set up a special version of the HIP venv for my gfx1030 architec…
Read the full story at r/LocalLLM ↗