AINewsnow

strix-llama new branch: prompt processing +21–54% over Vulkan and up to 2.7× over stock ROCm kernel at 128k, same outputs quality

I've been tuning llama.cpp on my Strix Halo box (Radeon 8060S, 128 GB) and the numbers are good enough to share. It's a branch called rdna35-perf on top of halo-box/strix-llama.cpp , a llama.cpp fork aimed at Strix Halo: https://github.com/asf0/strix-llama.cpp/tree/rdna35-perf (10 commits, ROCm/HIP…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-12 04:09 · r/LocalLLaMA
    strix-llama new branch: prompt processing +21–54% over Vulkan and up to 2.7× over stock ROCm kernel at 128k, same outputs quality

More stories

  1. Qwen3.8: Flash Next iq3 xxs is dumber than 27B iq3 xxs? — r/LocalLLM
  2. Qwen3.6 35B-A3B optimized for a 4 GB GTX 1050 Ti Mobile: up to 2× prefill and 3× decode vs llama.cpp — r/LocalLLM
  3. Do you actually test open-model inference compatibility? — r/LocalLLaMA
  4. PSA: DeepSeek V4.1 Flash habitually exfiltrates API keys. It is dangerously misaligned and may be hazardous to use — r/LocalLLaMA
  5. Benchmarked 4 Local Models on 3 Harnesses — r/LocalLLM
  6. What local AI and software do you use? Which is best? — r/LocalLLM
  7. Gemma4 E4B EXL3 - Alternative to Llama.cpp on Jetson Orin — r/LocalLLaMA
  8. Pancho the Llama talks (Part II) — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →