AINewsnow

320B model (GLM-5.3-Flash) at ~7 tok/s on an 11GB 2080 Ti, thanks to 256GB of pre-boom RAM

I do security research on the side. Frontier models are great, but their guardrails keep interrupting my workflow (fair enough, honestly), so I wanted a local option. My GPU is an old 2080 Ti with 11GB of VRAM, so I assumed no good model would fit. But the box also has 256GB of DDR4 I bought before…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-21 16:19 · r/LocalLLM
    320B model (GLM-5.3-Flash) at ~7 tok/s on an 11GB 2080 Ti, thanks to 256GB of pre-boom RAM

More stories

  1. A hot-expert cache made a 181 GiB model faster on one 96 GiB GPU — DEV Community — Machine Learning
  2. Z.ai's GLM-4.5-Air Packs 106B Agent Reasoning Into 12B Active Compute — AlphaSignal
  3. "Uncensored" models and refusals on Qwen3.8/GLM5.3-Flash — r/LocalLLM
  4. GLM-5.3 Sometimes Considers How Train-Time Actions Shape Future Behavior — LessWrong (Curated)
  5. Who is Yuki Chen, China’s ‘superstar’ hacker who just joined AI leader Z.ai? — South China Morning Post Tech
  6. OpenAI brings frontier models and Codex to Google Cloud — OpenAI News
  7. OpenAI acquires Orchestra Bio to fold drug-development agents into Rosalind — OpenAI News
  8. OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI

Get the daily brief of stories like this at 6:30 every morning →