Homelabber runs 2.8-trillion-parameter Kimi K3 on CPU alone using Optane memory sticks

A Reddit homelab user ran Moonshot AI's 2.8-trillion-parameter Kimi K3 CPU-only on second-gen Optane PMem 200 memory at 0.85 tokens/s using a 1-bit quantization.

Read the full story at Tom's Hardware ↗

Timeline · 1 report

2026-11-08 12:20 · Tom's Hardware
Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone

More stories

Chinese AI lab Moonshot reportedly sought European data centers for Nvidia chip access — CNBC Technology
China's AI models, led by Kimi, dominate open-source enterprise spending — South China Morning Post Tech
Moonshot Just Put a 2.8-Trillion-Parameter Model on Hugging Face — Kimi K3.1 Pro's Open Weights Are Real, and the Fine Print Matters — DEV Community — AI
MaxxBench (RLVR'd LLMs fail easy variants of DeepSWE tasks + obsess over "hidden tests" and pleasing the grader) — r/mlscaling
Harness Leaderboard - Kimi Code, Hermes, Pi, Claude Code, Codex, and Others Were Benchmarked Against Terminal Bench 2.1 & Deep SWE 1.1 — r/LocalLLaMA
Chinese Model Kimi K3 Breaks UK AI Safety Institute Benchmark Evaluations — AI Incident Database
Lessons from putting 14 coding-agent CLIs behind one interface — DEV Community — AI
Latest Open-Source Labs are gutting away cybersecurity and reverse-engineering capabilities — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →