AINewsnow

v100 16g *4 running qwen3.8 27b nvfp4 in 353t/s!!!!

Hi guys it me again who did 2v100 to 181t/s , and im back with this. The legend of V100 IS NEVER END , v100 FOREVERRRRR arguements: qwen3.8 27b nvfp4 , 256k max content , kv q8 , mtp4/0 repo: https://github.com/tuxKOH/ninfer-v100xN (yes i changed name to xN from x2 because tp4 is supported) submitt…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-24 18:11 · r/LocalLLM
    v100 16g *4 running qwen3.8 27b nvfp4 in 353t/s!!!!

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Securing our frontier model training environment — OpenAI News
  3. DeepSeek V4 Flash API prices compared across providers (Oct 2026) — r/huggingface
  4. Block unveils Dessa, a "true speech-to-speech" AI model trained on "nothing but human conversation" that it says runs locally on a MacBook Pro M4 Max or newer — Techmeme
  5. UK to invest £100m in 'world first' AI Biosecurity Lab — BBC Technology
  6. Fired OpenAI researchers say independent safety audits aren't going well — NPR Technology
  7. Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3 — r/LocalLLM
  8. Clean Energy Has a Lot Riding on the AI Data Center Boom — TIME Tech

Get the daily brief of stories like this at 6:30 every morning →