Qwen3.8-27B on 4× Intel Arc Pro B70 with TensorFold + DFlash2: 107 tok/s per card, ~1,000 tok/s across 32 streams (bit-exact)
This story is from 2026-11-16. It is preserved in the archive; the latest stories are on the live feed.
I benchmarked TensorFold's XPU backend on my quad Intel Arc Pro B70 box. One clarification first: this is not tensor parallel. The XPU backend on main uses one card per process, so the quad numbers come from 4 independent servers, one per GPU, pinned with ZE_AFFINITY_MASK=0..3 . Setup GPUs: 4× Inte…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-16 00:47 · r/LocalLLM
Qwen3.8-27B on 4× Intel Arc Pro B70 with TensorFold + DFlash2: 107 tok/s per card, ~1,000 tok/s across 32 streams (bit-exact)
More stories
- Google launches Gemini 4 Neon mid-tier model and opens Genie 4 to Gemini API developers — Google DeepMind YouTube
- Anthropic begins trading in record IPO, shares surge on debut — Anthropic (X)
- Google books Blue Origin's New Glenn for 2029 launch of AI server satellites — Google: The Keyword
- AWS expands SageMaker JumpStart with OpenTSLM, model leaderboard, and PolyAI Dialog-RSN-1 — AWS Machine Learning Blog
- Nvidia scandal accelerates US AI chip export controls on China — NPR Technology
- Microsoft CEO warns AI-driven bug discovery is raising the pace of tech outages — OpenAI News
- ChatGPT, Claude, Gemini and Grok helped plan terror attacks in US government test — The Independent Tech
- AWS Adds Managed NVIDIA Dynamo Support to SageMaker HyperPod Inference — AWS Machine Learning Blog
Read the Daily Brief: the day's most important AI stories →