AINewsnow

WHIRL 0.2.0 now runs on the AMD Ryzen AI Max+ 395 (Radeon 8060S): native Windows LLM engine, faster than llama.cpp ROCm and Vulkan from 2k to ~250k tokens (also on the Radeon AI PRO R9700)

New in 0.2.0: the AMD Ryzen AI Max+ 395 (Radeon 8060S) is supported , with kernels tuned for it, all three numerics modes and prompts up to ~250k tokens. WHIRL is an open-source (Apache-2.0) inference engine for AMD GPUs on Windows: C++/HIP, every kernel in the repo, no WSL, no ROCm install. Downlo…

Read the full story at r/LocalLLM ↗

Timeline · 2 reports

  1. 2026-10-17 12:43 · r/LocalLLM
    I benchmarked 12 local LLMs on an AMD Ryzen AI MAX+ 395 with 128 GB RAM — quality, speed, coding and MCP tool calling
  2. 2026-10-17 12:06 · r/LocalLLM
    WHIRL 0.2.0 now runs on the AMD Ryzen AI Max+ 395 (Radeon 8060S): native Windows LLM engine, faster than llama.cpp ROCm and Vulkan from 2k to ~250k tokens (also on the Radeon AI PRO R9700)

More stories

  1. User friendly GUI for configuring and launching llama.cpp — r/LocalLLM
  2. A Lab Just Open-Sourced Its Training Harness (Plus 501B Weights) — DEV Community — Machine Learning
  3. Arc Pro B60 runs a 27B coding model at 53 tok/s: full recipe, flags and raw logs — r/LocalLLM
  4. Unsloth's Llama 3.2 Mirror Hits 800K Downloads by Removing Meta's Login Wall — AlphaSignal
  5. V100 16GB: A 2017 GPU running a 35B vision model at 93 tok/s: Tesla V100 16 GB on Windows — r/LocalLLM
  6. 780m and Gemma 4 26b a4b — r/LocalLLM
  7. llama.cpp has come a long way — r/LocalLLaMA
  8. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →