AINewsnow

Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards

This will be my third update on the bc-250 cluster and for my first forray into local ai I have been having a blast. This has turned from a weekend experiment into something I think I will use in the future. I am running 4 BC-250 boards connected by 2.5gb ethernet adapters to a 2.5gb switch using l…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-11 04:27 · r/LocalLLaMA
    Running Next Flash IQ3_XXS at ~70 tok/s with 100k context or 2 instances of Qwen 3.6 35B A3B IQ4 at ~145 tok/s with 256k all on $500 of ex mining BC-250 boards

More stories

  1. Alibaba launches new Qwen smart glasses with 50MP cameras, AI features to rival Meta's Ray-Ban; check price — Mint AI
  2. Total Chaos - New ComfyUI Users (Qwen image 2.1 and Minimax H3) — r/comfyui
  3. What setup do you use, which harness? and how do you customize it to run qwen 3.8 flash next swift with a high context length and a reasonable amount of tok/sec? — r/LocalLLaMA
  4. Current best image editing model? — r/comfyui
  5. QWEN 2.1 for video — r/comfyui
  6. What's the minimum hardware for AI training? — r/LocalLLM
  7. Alibaba Prepares Qwen Go Personal AI Assistant for Task Automation — TechNode
  8. Build a free content tool of GPU owners — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →