AINewsnow

Qwen3.6-35B-A3B at ~70 tok/s on a 16GB AMD RX 9060 XT GPU: my PolyStrata HIP journey

TL;DR: I ported PolyStrata’s experimental strata-poly GGUF engine to AMD HIP and worked on its memory management and performance. On an RX 9060 XT 16GB, Ryzen 5 5600X and 32GB RAM, running Windows 11 , Qwen3.6-35B-A3B UD-Q3_K_M recorded 70.7 tok/s generation on a 31K prompt with MTP/speculation ena…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-18 15:22 · r/LocalLLM
    Qwen3.6-35B-A3B at ~70 tok/s on a 16GB AMD RX 9060 XT GPU: my PolyStrata HIP journey

More stories

  1. Anthropic grants METR researchers employee-level access for independent risk assessments — TechCrunch AI
  2. FLUX 3 Image Klein launch issues prompt ComfyUI update and community comparisons — r/LocalLLaMA
  3. DeepSeek releases MIT-licensed V4.1-Flash-1017 with improved agentic coding — Vercel Blog
  4. NVIDIA RTX Spark Laptops Launch Globally With Local AI Agent Support — NVIDIA Blog
  5. MOSS-Image gains traction with fast generation and ecosystem support — r/StableDiffusion
  6. Discussions on AI's Role in Media and Societal Adaptation — New York Times AI
  7. Anthropic pitches AI safety bill to US lawmakers — Politico Technology
  8. Amazon launches Bee Frontier AI wearable amid privacy concerns — CNBC Technology

Get the daily brief of stories like this at 6:30 every morning →