AINewsnow

Speedy - custom Strata for single/dual RTX - Tested on RTX 3080 with 4,270 t/s prefill / up to 211 t/s decode - fastest Qwen3.8 Flash-Next engine I know

So I've been tinkering for quite some time into trying to squeeze the best out of my AI / Home server together with Qwen 3.8 Flash Next. Tried multiple software / engines / etc and eventually came down to Strata, then built (together with my pal Claudinho) on top of it multiple changes based on var…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-02 06:51 · r/LocalLLM
    Speedy - custom Strata for single/dual RTX - Tested on RTX 3080 with 4,270 t/s prefill / up to 211 t/s decode - fastest Qwen3.8 Flash-Next engine I know

More stories

  1. Apple Intelligence to launch in China in December with Alibaba's Qwen model — The Verge AI
  2. Experimental 'Qwenputer' embeds a 32-bit RISC-V CPU into an LLM's weights and runs DOOM — Tom's Hardware
  3. Your LLM Judge Agrees With Itself. That Is Not an Eval. — DEV Community — Machine Learning
  4. Memdoor: A team of 5 Qwen3.8-27B models beats Fable 5 on LiveCodeBench Hard — r/LocalLLaMA
  5. 😺 Microsoft's binding AI school deal — The Neuron
  6. Betelgeuse: Running Qwen 3.8 Flash Next at 22 tok/s sustained (spiking to 48 tok/s) on an RTX 3060 12GB + 16GB DDR4 RAM 100% bit-exact! — r/LocalLLaMA
  7. Claude Code for Free in VS Code: No Login, No API Key (Ollama + Qwen 3.8) — DEV Community — AI
  8. Qwen Image 2.1 Reconstruction: Visual Prompts, Empty Latents, and a Pixel Budget — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →