AINewsnow

Flash next rig born from mining parts.

Been testing 3x 3060 12gb for flash next in an open air frame. Honestly, with strata it's kicking ass. 38-40 t/s while llama.cpp can only get 13.2 t/s. This is on IQ3 through strata. Anybody else running dated mining hardware with decent success? PS flash next kicks ass. Rig details: - Kingwin 8x m…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-03 17:36 · r/LocalLLaMA
    Flash next rig born from mining parts.

More stories

  1. Open source inference engine (like LM Studio or Unsloth Desktop) that optimizes itself for your exact hardware. Compiles and tunes its kernels on your device, so open models run up to 2x faster than llama.cpp. Works on Apple Silicon, NVIDIA, AMD or nothing but a CPU. — r/LocalLLaMA
  2. Qwen Flash Next MTP work restarted — r/LocalLLaMA
  3. Pi extension: Skip reasoning with local Qwen 27B and proceed to answer right now — r/LocalLLaMA
  4. Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp — r/LocalLLaMA
  5. FreeToken vs llama.cpp on one RTX 3090: llama.cpp is 2–3× faster when the MoE fits in VRAM. On gpt-oss-120b (63 GB), FreeToken gets the first token out 7× faster at 32 concurrent users. — r/LocalLLaMA
  6. The Rise of Overfit Inference Engines — r/LocalLLaMA
  7. Imma just say it, Strata absolutely clowned llama.cpp — r/LocalLLaMA
  8. Claude and Grok built me a local monitoring setup for my AI box: two dashboards, one for the machine, one for model training — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →