AINewsnow

Ornith-1.5-122B on one 24 GB GPU + 32 GB RAM: 22 tok/s on real coding output, 350 tok/s prompt (patched Strata, ROCm)

What Result Decode, real coding prompt ~22 tok/s (21-25 across runs) Prompt processing, 8.9K-token prompt 407 tok/s (22 s) Decode at 9K context 12.2 tok/s How, in short: Experts placed by a profile recorded on coding tasks: the most used ones in VRAM, the next 18 GB in a RAM tier, the rare rest rea…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-27 12:33 · r/LocalLLM
    Ornith-1.5-122B on one 24 GB GPU + 32 GB RAM: 22 tok/s on real coding output, 350 tok/s prompt (patched Strata, ROCm)

More stories

  1. Meta announces $95B offering to fund AI — Semafor Technology
  2. Introducing GPT-6.1 Terra — OpenAI News
  3. Apple unveils a 14" MacBook Pro with an M6, which has a 12-core CPU and a 12-core GPU, 16GB or 32GB of unified memory, and Wi-Fi 7, for $1,999+ from November 6 (Apple) — Techmeme
  4. Microsoft offers buyouts to 60,000 employees — The Verge AI
  5. OpenAI announces three big science discoveries and a new way to work with academics — The Verge AI
  6. Anthropic’s IPO filing lays out a plan to ‘revolutionize every area of human endeavor' with AI — The Verge AI
  7. How AI Is Changing the Pace of Discovery for Millions Living With Dementia — NVIDIA Blog
  8. 8 examples of Gemini 4 Argon in action — Google Gemini Blog

Get the daily brief of stories like this at 6:30 every morning →