AINewsnow

Full 753B GLM-5.3 running on two DGX Sparks at 18-24 tok/s, 262k context, every expert kept

Hey all, I quantised the full GLM-5.3 (753B total, about 40B active per token) to run on two DGX Sparks. As far as I can tell, it's the only full build on 2 Sparks. Others need 3 or 4. Runtime ablation also! - Routed experts: mixed-width EXL3, about 2 bits per weight - Backbone: FP8 weights as rele…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-05 17:31 · r/LocalLLM
    Full 753B GLM-5.3 running on two DGX Sparks at 18-24 tok/s, 262k context, every expert kept

More stories

  1. GLM-5.3-CYBERSECURITY-FP8: Inside the Refusal-Removed AI Model for Red Teaming — DEV Community — Machine Learning
  2. Moonshot Just Put a 2.8-Trillion-Parameter Model on Hugging Face — Kimi K3.1 Pro's Open Weights Are Real, and the Fine Print Matters — DEV Community — AI
  3. VEKTOR 2.0.5: 88 MCP tool runs Improved—GLM-5.3-Flash with 1 million trial tokens — DEV Community — AI
  4. Nearly 5 the output from the same eight B200s — DEV Community — AI
  5. We built our own inference engine and put it up against vLLM and SGLang on four models and three kinds of GPU. — DEV Community — Machine Learning
  6. AI Inference Benchmark: Keln vs Fireworks, Together AI, Baseten, Modal, DeepInfra & Z.ai — DEV Community — AI
  7. Z.ai chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B) — r/LocalLLaMA
  8. Free Chinese AI Models Show Hacking Skills Close to OpenAI's Advanced Cyber Model — Wired AI

Get the daily brief of stories like this at 6:30 every morning →