Qwen3.8-27B FP8 dual GPUs
Hardware RTX 5090 (32 GB) + RTX 4070 Ti Super (16 GB) = 48 GB VRAM 32 GB DDR5 6200 RAM Arch Linux, KDE on the 5090 (takes ~1-1.5 GB VRAM) daily driver OrcaRouter Qwen3.8-27B Uncensored, block-FP8 (28.75 GiB), on vLLM 0.30.0 with pipeline parallel across both cards 4070 = rank 0 with layers 0-19 + v…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-27 11:15 · r/LocalLLaMA
Qwen3.8-27B FP8 dual GPUs