AINewsnow

A Strata fork for IBM AC922 running Qwen3.8-FN UD-Q4_K_XL is doing up to 7,357 tk/s prefill and 113 tk/s decode

This story is from 2026-10-04. It is preserved in the archive; the latest stories are on the live feed.

I forked Strata and worked with Opus 5.5 with some heavy changes to it to make it work on an IBM AC922 I have access to. The IBM AC922 is a 2018 era beast with two POWER9 20 core SMT4 CPUs that are connected by NVLink to 4 or 6 NVIDIA Tesla V100 SXM2 GPUs, the CPU-GPU BW advertised as 150GB/s and t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-04 16:25 · r/LocalLLaMA
    A Strata fork for IBM AC922 running Qwen3.8-FN UD-Q4_K_XL is doing up to 7,357 tk/s prefill and 113 tk/s decode

More stories

  1. Here are Tuesday's biggest analyst calls: Nvidia, Anthropic, SpaceX, Amazon, Tesla, Alphabet, BlackRock & more — CNBC Technology
  2. Breakingviews - COMMENTARY: Nvidia leaves the AI trade hanging in purgatory — Reuters AI
  3. Nvidia scandal spurs tighter US AI chip export controls on China — DigiTimes Asia
  4. AWS Adds Managed NVIDIA Dynamo Support to SageMaker HyperPod Inference — AWS Machine Learning Blog
  5. Chinese tech firms brace for AI setbacks as US chip curbs tighten — Washington Post AI
  6. US proposal to curb China's remote access to AI chips rattles Southeast Asia's data center boom — DigiTimes Asia
  7. NVIDIA Details How Developers Build Simulations With Frontier AI Agents in Omniverse — NVIDIA Blog
  8. Anthropic Appears Among Market-Moving Names Across Recent Trading Sessions — Barron's

Read the Daily Brief: the day's most important AI stories →