AINewsnow

Running a 180B Model on a Gaming Laptop: POCKET-Darwin-180B

TL;DR VIDRAFT released POCKET-Darwin-180B, a 180B-parameter model that runs on a consumer gaming laptop with 8GB of VRAM and 32GB of system memory. It uses a sparse Mixture-of-Experts design, SSD streaming, and the llama.cpp runtime. The point is not to beat a cloud API on speed. The point is to re…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-08 01:59 · DEV Community — Machine Learning
    Running a 180B Model on a Gaming Laptop: POCKET-Darwin-180B

More stories

  1. ~188k warm ~60–67 tok/s: Qwen3.8-Flash-Next NVFP4 with Strata on a single RTX PRO 4500 32GB + 64GB DDR5. — r/huggingface
  2. Qwen3.8-Flash-Next (125B) on a single Strix Halo mini PC: 44-59 tok/s with speculative decoding, ~1,400 tok/s prefill, engine is open — r/LocalLLaMA
  3. RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp — r/LocalLLaMA
  4. llama.cpp on the stage — r/LocalLLaMA
  5. Inference Mode + UI Model Swap + Harness stats (Custom OS) — r/LocalLLM
  6. How comparable is a MacBook Pro M5 Pro 64GB 18/20 vs RTX4090 | 128 GB DDR5 — r/LocalLLM
  7. Looking for developer-friendly inference providers who give you enough API credits to experiment [D] — r/MachineLearning
  8. Ternary Bonsai 2 27B on a 12 GB Intel Arc B580: 128K context, ~80-90 t/s code, 250+ t/s edits, 44 t/s at 115K — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →