AINewsnow

Open Source Kernel in Qwen3.6-35B-A3B for AMD MI350X: 78,498 output tok/s on 8 GPUs

This story is from 2026-08-26. It is preserved in the archive; the latest stories are on the live feed.

So here's the thing, almost everyone use NVIDIA to run their LLMs, we also do the same, a lot of people we've met use like RTX PRO 6000 or even H100, B300 It seems like everyone eyes is looking at NVIDIA. However we do the math that the raw power alone on AMD GPU MI350X is higher than NVIDIA B200.…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-08-26 04:12 · r/LocalLLaMA
    Open Source Kernel in Qwen3.6-35B-A3B for AMD MI350X: 78,498 output tok/s on 8 GPUs

More stories

  1. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  2. Building an open-source 500+ language Sparse MoE translation model from scratch (Apache 2.0) — r/huggingface
  3. what's the state of the art recipe for running Qwen3.8-Flash-Next with a pair of 3090s and a ton of system RAM rn? — r/LocalLLaMA
  4. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  5. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  6. Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second. — r/LocalLLaMA
  7. FREE AI TRAINING CREDIT — r/learnmachinelearning
  8. No one is surprised that Nvidia's Jensen Huang thinks AI fears are overblown. — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →