AINewsnow

Gufo performance .... 70tps Qwen 3.8 27b but you need to read the fine print.

This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.

So everyone has been yelling about how I should be using Gufo instead of halogen because it's open source and it's "just as good or better". Checking in on their GitHub (GitHub.com/gufo-org/gufo) got me immediately .. "Qwen 27B Q4: 70.56 tok/s single user, 123 tok/s with 8 users" on a strix halo de…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-02 05:36 · r/LocalLLM
    Gufo performance .... 70tps Qwen 3.8 27b but you need to read the fine print.
  2. 2026-10-01 21:18 · r/LocalLLaMA
    Gufo performance .... 70tps Qwen 3.8 27b but you need to read the fine print.

More stories

  1. Weight-space programming is not autonomous self-improvement — DEV Community — Machine Learning
  2. ANT is going to see some crazy action when Qwen 4 releases. — r/LocalLLaMA
  3. First time trying FP16, wow — r/LocalLLM
  4. Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090 — r/LocalLLaMA
  5. Qwen Image 2.1 Turbo: Eight Steps Against Twenty-Five, and Eight ControlNet Modes — DEV Community — AI
  6. FLUX.3 Klein Qwen 2.1: A Pose-and-Outfit Matrix Built From 1407 Garments and 1439 Pose Images — DEV Community — AI
  7. Running Llama 3.2 & Qwen 2.5 100% Offline in React Native & Expo 52: Solving Thermal Throttling, OOMs, and Background Streaming — DEV Community — AI
  8. [ Video ] Local AI: Running Alpie Seed on a 16GB MacBook Pro — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →