Cheap inference
Or something like that. Maybe even too cheap. This is a follow up from my last post: https://www.reddit.com/r/LocalLLM/comments/1wi96ir/first_setup_dual_1080ti_for_qwen38_27b/ 2x 1080ti 11gb - 140€ used each Runs perfectly fine on a 500w psu ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ2_XS-mtp 2048 cont…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-27 10:01 · r/LocalLLM
Cheap inference