GLM 5.3 Flash on 4xR9700 for 4 users
Hey y'all. Working on a go-to inference computer for teams using AMD GPUs and a custom stack, wanted to share our progress so far with GLM 5.3 Flash MXFP4 running tp=4 with MTP/Spec disabled. RAM: 128gb DDR5 RAM 5600 ECC CPU: EPYC 9005 9275F All 4 GPUs are capped at 210w, total power consumption su…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-12 01:30 · r/LocalLLM
GLM 5.3 Flash on 4xR9700 for 4 users