Update on the “Monstrosity”. 6 BC-250 board cluster
This is 6 bc-250 ex mining boards with 5 in the asrock 4u12g case they came in. After a lot of testing my current preferred setup is 4 boards running Qwen Next Flash IQ2_XS at 100k context with around 28 tok/s for short generation and 24 tok/s at 50k with around 115 ppt. The other two boards run 3.…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-02 02:49 · r/LocalLLaMA
Update on the “Monstrosity”. 6 BC-250 board cluster