AINewsnow

2× RTX PRO 6000 Blackwell Server Edition: Qwen3.8-Flash-Next, two TP1 replicas, 1M context, FP8 KV + shared Mooncake RAM cache

This story is from 2026-09-15. It is preserved in the archive; the latest stories are on the live feed.

We’re running Qwen3.8-Flash-Next NVFP4 on two RTX PRO 6000 Blackwell Server Edition GPUs, with a separate model instance on each card. Each instance is TP1. A customized gateway routes requests between the two replicas using least-inflight routing, and both instances can reuse prefix caches through…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-09-15 22:04 · r/LocalLLM
    RTX PRO 6000 Blackwell hitting 85–92°C under sustained AI workloads. Is this normal?
  2. 2026-09-15 12:46 · r/LocalLLM
    2× RTX PRO 6000 Blackwell Server Edition: Qwen3.8-Flash-Next, two TP1 replicas, 1M context, FP8 KV + shared Mooncake RAM cache

More stories

  1. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  2. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  3. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  4. AI safety fears: King Charles meets tech leaders, here’s what he told OpenAI, Nvidia, Anthropic, DeepMind leaders — Mint AI
  5. Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
  6. FREE AI TRAINING CREDIT — r/learnmachinelearning
  7. what's the state of the art recipe for running Qwen3.8-Flash-Next with a pair of 3090s and a ton of system RAM rn? — r/LocalLLaMA
  8. Dario Says AI Should Slow Down. Jensen Wants to Go Full Steam Ahead. — Wall Street Journal Technology

Get the daily brief of stories like this at 6:30 every morning →