AINewsnow

Does PCIe matter much for inference?

This story is from 2026-08-21. It is preserved in the archive; the latest stories are on the live feed.

Speaking of -sm tensor. I have 2x5060ti and i get some 40-50tps form 3.8 27B q6. I used HWinfo to see how saturated the PCIes are during inference are and as expected both the PCIe 5x16 slot and PCIe 4x4 were fully saturated. I cant help but feel like my 2nd gpu slot is a bottleneck (4x4), im consi…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-08-21 09:06 · r/LocalLLaMA
    Does PCIe matter much for inference?

More stories

  1. OpenAI launches Images 2.6 with animated GIF creation and faster image generation — OpenAI News
  2. OpenAI to acquire developer tooling startup Pierre Computer Company — OpenAI News
  3. OpenAI pipeline finds and patches 948 Linux privilege escalation flaws — OpenAI News
  4. Moonshot AI releases Kimi K3.1 Pro weights as Huawei adds day-one Ascend support — Techmeme
  5. Runway News | Runway Dev is in Claude Code, Codex and Cursor — Runway Research
  6. Claude Code product lead Cat Wu leaves Anthropic to join OpenAI — Business Insider AI
  7. Apple cuts engineers' daily AI spending caps in broader cost-control push — Bloomberg AI
  8. AMD takes $1.07 billion quarterly charge tied to OpenAI and Meta chip deals — Reuters AI

Get the daily brief of stories like this at 6:30 every morning →