Infatoshi Squeezes GLM-5.3's 753B Parameters Into 273 GiB for Multi-GPU Workstations

A 3-bit EXL3 quant squeezes a 753B uncensored GLM-5.3 Mixture of Experts into 273 GiB, making local inference possible on four RTX PRO 6000s.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-10-09 09:27 · AlphaSignal
Infatoshi Squeezes GLM-5.3's 753B Parameters Into 273 GiB for Multi-GPU Workstations

More stories

RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp — r/LocalLLaMA
I built Repowise, an open source codebase index for Claude Code. Here's what's new — r/ClaudeAI
Best current R9700 inference engine? — r/LocalLLaMA
AI-powered hacking tools enabled a likely single attacker to breach multiple South Korean banks — The Decoder
Can any open-weight models handle a decomp/recomp project yet? — r/LocalLLaMA
2x CMP 170HX 64GB: GLM-5.3-Flash at 384K context / ~90 tok/s (EXL3, HBM-first setup) + Qwen3.8 comparison — r/LocalLLaMA
GPT-6 and Intelligent UI for everyone — OpenAI News
Introducing Mistral Large 4 — Mistral AI News

Get the daily brief of stories like this at 6:30 every morning →