Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below
Posted this on the r/R9700 subreddit as well, but figured I'd share my initial findings here. tl;dr - One user writes at about 190 tok/s. Prefill runs at about 6,800 tok/s total no matter how many users there are. Agent follow-ups start in 0.2 to 2.5 s and write at 80 to 225 tok/s per user, even wi…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-08 23:36 · r/LocalLLaMA
Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below