AINewsnow

Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090

Hi everyone! I wanted to post a quick update on Basalt . Since last I posted, multi model and router support was implemented, starting with DeepSeek V4.1 Flash (IQ1_M 90 tok/s conv, 246 tok/s struct on a 5090 + 5060 Ti). Also new: video support, files in chats, and a bunch of fixes and improvements…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-15 17:30 · r/LocalLLaMA
    Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090

More stories

  1. How to Deploy DeepSeek-R1 & Qwen on Azure with Scale-to-Zero ($0 Idle Bill) — DEV Community — AI
  2. DeepSeek API Expansions, Local 284B MoE Runs, and New Developer Tooling — DEV Community — Machine Learning
  3. I ran the same Halloween animation prompt through five coding agents on one local Qwen model — r/LocalLLaMA
  4. Study audits major LLMs for racial and sex bias in pain management — arXiv cs.CL
  5. Researchers allege Chinese AI models were trained on export-banned Nvidia Blackwell chips — Bloomberg AI
  6. Weight-space programming is not autonomous self-improvement — DEV Community — Machine Learning
  7. ANT is going to see some crazy action when Qwen 4 releases. — r/LocalLLaMA
  8. Show HN: DeepSeek V3 in ~200 lines of pure Jax — Hacker News Front Page

Get the daily brief of stories like this at 6:30 every morning →