Qwen3.8-27B W4A16 on one 64 GB CMP 170HX - 160+/70+ decode on short/long CTX + 1M YaRN CTX
This story is from 2026-08-30. It is preserved in the archive; the latest stories are on the live feed.
WARNING: text organized and finalized with sol (theres too much lol, spent two days finetuning). Post is really long, so TLDR first I have been building a single-user Qwen3.8-27B endpoint on an unlocked 64 GB CMP 170HX installed in a cheap Huanan/Xeon server. The card is tuned live with 170tune . T…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-08-30 11:25 · r/LocalLLM
Qwen3.8-27B W4A16 on one 64 GB CMP 170HX - 160+/70+ decode on short/long CTX + 1M YaRN CTX