AINewsnow

Ling 3.1 Flash (560B MoE) loaded across 4 DGX Sparks using llama.cpp RPC

sudoing posted that he's loaded Ling 3.1 Flash across four DGX Sparks. It's a 560B MoE with 25B active parameters per token. He'd enjoyed the earlier Ling models and wanted to test this one, but it wouldn't fit on his two Sparks with the setup he was trying. someone in Germany gave him access to a…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-18 05:37 · r/LocalLLaMA
    Ling 3.1 Flash (560B MoE) loaded across 4 DGX Sparks using llama.cpp RPC

More stories

  1. DeepSeek V4.1 Flash is now available in Token Pass — Vercel Blog
  2. How to squeeze the Max Token from M1 Max 64gb? — r/LocalLLaMA
  3. Qwen3.8-Flash-Next 125B Q2_0 on a 24GB M4 Mac mini: ~8.1 tok/s with Strata — r/LocalLLM
  4. Eagle-4 Released: Faster than DFlash2 & DSpark — r/LocalLLaMA
  5. Intel Arc B580 now beats an RTX 5060 Ti on llama.cpp prompt processing (Llama 2 7B), plus 1.5x faster long chats — r/LocalLLM
  6. Qwen3.6-35B-A3B (22 GB, 4-bit) on a 16 GB Mac mini M4 through stock llama.cpp: speed, a 4-agent crew, and executed code scores — r/LocalLLM
  7. Geezuz kernel: Qwen3.8-27B at 190 tok/s (620~ tok/s at 8 requests) on two 3090s — r/LocalLLaMA
  8. 12GB VRAM + 16GB RAM is enough for very smart local AI with 120K+ context — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →