AINewsnow

Monolithic ddr3 server

Hi all. Do any of you guys run a server like this for inference of big models. Given deepseek is down to 8/16b active I'm curious as to whether this could start to make sense if I was to add a gpu. This server is local for $550 USD. Dell PowerEdge R820 4x CPU E5-4640 768GB RAM 2x 146GB HDD Server 7…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-25 20:34 · r/LocalLLaMA
    Monolithic ddr3 server

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Maya-XS runs DeepSeek-V4.1-Flash in 120.6 GB, with all 384 experts resident in GPU memory on a 128 GB Ryzen AI Max. — r/LocalLLaMA
  3. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
  4. Qwen 3.8 Flash Next (129 GB) is better than 2.6 bpw DeepSeek V4.1 Flash 1017 (187 GB + 203 GB Engram) — r/LocalLLaMA
  5. Did anyone checked the DeepSeek repo — r/ArtificialInteligence
  6. DeepSeek and MiniMax cleared to take AI models abroad, state media says — The Next Web
  7. For those running Deepseek 4.1, what are you using? — r/LocalLLM
  8. Meet Groot — four smaller models for reasoning, coding and tool use — r/huggingface

Get the daily brief of stories like this at 6:30 every morning →