AINewsnow

[Update Benchmark] Basalt's new PRs (Strata fork) new record IQ3_S Qwen3.8 Flash Next on single RTX 5080 and 51 GB RAM with 5500 tok/s prompt processing and up to 275 tok/s peak generation (during opencode coding live session)

Code and tool calls can peak up to 275 tok/s - Reasoning traces up to 190 tok/s Hardware: 5080 16GB PCIe gen5x16, 64 DDR5 6400, Core Ultra 9 285K https://github.com/jesdga95/basalt Some PRs for the optimizations under my name are still pending (xyehya) but upstream already have solid gains & memory…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-29 03:57 · r/LocalLLaMA
    [Update Benchmark] Basalt's new PRs (Strata fork) new record IQ3_S Qwen3.8 Flash Next on single RTX 5080 and 51 GB RAM with 5500 tok/s prompt processing and up to 275 tok/s peak generation (during opencode coding live session)

More stories

  1. Google launches Gemini 4 Carbon with a ‘significant leap’ in cybersecurity — The Verge AI
  2. Google's Gemini 4 Carbon Tops AI Rankings and Hunts Security Bugs for Days — AlphaSignal
  3. Gemini 4 Carbon: our next frontier model — Google Gemini Blog
  4. Google announces the expansion of ads in AI Mode into international markets, as growth in its core search advertising business slows — Techmeme
  5. Sources: the US DOJ has inquired about the impact of Nvidia's Hugging Face deal on AI competition, as antitrust enforcers continue to probe Nvidia's conduct (Reuters) — Techmeme
  6. Google AI gets cagey when asked who won the 2020 elections — Ars Technica AI
  7. Grok can launch a thousand ships – but this AI remake of the Odyssey can’t make us feel — The Conversation AI (US)
  8. OpenAI and ServiceNow expand partnership across enterprise workflows — OpenAI News

Get the daily brief of stories like this at 6:30 every morning →