AINewsnow

Running NInfer on Dual RTX 3090's + NVLink

This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.

DISCLAIMER: AI generated code/slop ahead. You have been warned. I just recently heard about the new NInfer engine optimized for NVIDIA cards, and wanted to take advantage of the speed gains on my two 3090's. Only problem: I overpaid for a 4-slot NVLink connector when I bought the cards, and I am da…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-08-21 08:25 · r/LocalLLM
    Running NInfer on Dual RTX 3090's + NVLink

More stories

  1. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  2. Building an open-source 500+ language Sparse MoE translation model from scratch (Apache 2.0) — r/huggingface
  3. what's the state of the art recipe for running Qwen3.8-Flash-Next with a pair of 3090s and a ton of system RAM rn? — r/LocalLLaMA
  4. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  5. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  6. Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second. — r/LocalLLaMA
  7. FREE AI TRAINING CREDIT — r/learnmachinelearning
  8. No one is surprised that Nvidia's Jensen Huang thinks AI fears are overblown. — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →