AINewsnow

$5400 eBay 8x V100 server cranks on flash-next

This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.

Had opus 5.5 do the bring up.. super solid results. Using only 4 GPU results in KV of like 120k with image on. 27B TP=4 results in >200 tok/s with dflash, prefill around 2.5-3.5k. Both these are running the nvfp4 Nvidia checkpoints. Found a magic repo that unpacks into fp16 on the fly ( https://git…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-01 13:44 · r/LocalLLaMA
    $5400 eBay 8x V100 server cranks on flash-next

More stories

  1. Jensen Huang resigns as Nvidia CEO amid spy scandal tied to alleged use of banned Blackwell chips in China — TechCrunch AI
  2. Jensen Huang resigns as Nvidia CEO, board says departure effective immediately — DEV Community — AI
  3. Treasury Secretary Bessent calls for accountability over Nvidia AI chips reaching China — The Next Web
  4. Lawyer's eight-V100 server runs DeepSeek-V4.1-Flash locally at near-NVFP4 quality — r/machinelearningnews
  5. Malaysia probes whether imported Nvidia-linked AI chips were re-exported — Vox Artificial Intelligence
  6. Nvidia turmoil rattles AI sector as neocloud and AI stocks slide — Techmeme
  7. Nvidia scandal looms over US-China AI talks — Barron's
  8. AI Chip and Cloud Stocks Swing as CoreWeave Earnings Drive Market Rally and Sell-Off — The Globe and Mail

Get the daily brief of stories like this at 6:30 every morning →