Follow-up: instead of buying a big DDR3 board, I split GLM-5.3-Flash across my two small x79 ud3 (4× rtx 3060) boxes over 1 GbE: ~40 tok/s, 6–7 s agent turns, 48/48 on my coding bench
Follow-up to my earlier post . Where I ended up: a big DDR3 workstation board isn't worth the money when I already have two small 4-GPU boxes. So I tried making the two boxes act as one. TL;DR: I added a two-box layer split to Project Maya. Box A runs layers 0–23, Box B runs layers 24–44 plus the h…
Read the full story at r/LocalLLM ↗