AINewsnow

Strata is the shit

Have been using qwen 3.8 flash next with llamaserver. Was getting 70-80tk/s decode and was happy. Then read about strata and decided to give it a try. Decode shot up to 150 tk/s. Not sure what magic it's using? You should give it a try if you are still running qwen flash next on llamacpp. Also the…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-03 13:39 · r/LocalLLaMA
    Strata is the shit

More stories

  1. Runway News | Runway Dev is in Claude Code, Codex and Cursor — Runway Research
  2. Apple Intelligence with Alibaba comes to China in December — Computerworld AI
  3. Apple begins AI trial in China, powered by Alibaba — Euronews Next
  4. A beginner's guide to the Qwen-Image-2.1-Turbo-Quantized model by Abenzerps on Huggingface — DEV Community — Machine Learning
  5. AI Daily Digest November 2, 2026: Four AI Giants Back One robots.txt Token, ChatGPT and Codex Merge Quotas, Apple Puts Qwen Inside Siri — DEV Community — AI
  6. We will take your RAM — r/StableDiffusion
  7. Chat memory as a 41.9 MB file: building on MemT-1.0-Nano's save and reload — DEV Community — Machine Learning
  8. A Small Weight Edit Helped Qwen Finish Its Reasoning. That Defines the Result. — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →