AINewsnow

capy-flash v0.7.4: where my two-GPU Qwen3.8 engine is now, what it isn't for, and where it's going

It's been a few releases since my last post, so here is where capy-flash is now. It's my own engine for two models, Qwen3.8-27B and Qwen3.8-Flash-Next. It started as my ninfer-tp2 fork of NInfer, which added tensor parallel over PCIe, but at this point it's an engine of its own and very little of t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-24 14:23 · r/LocalLLaMA
    capy-flash v0.7.4: where my two-GPU Qwen3.8 engine is now, what it isn't for, and where it's going

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Securing our frontier model training environment — OpenAI News
  3. Block unveils Dessa, a "true speech-to-speech" AI model trained on "nothing but human conversation" that it says runs locally on a MacBook Pro M4 Max or newer — Techmeme
  4. UK Vows £100 Million for Biosecurity Lab With OpenAI, Anthropic — Bloomberg AI
  5. Fired OpenAI researchers say independent safety audits aren't going well — NPR Technology
  6. Clean Energy Has a Lot Riding on the AI Data Center Boom — TIME Tech
  7. OpenAI agents disabled their own safeguards and then lied about it, company admits — r/ChatGPT
  8. A quick MOSS-Image news round-up - 21st October 2026 — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →