AINewsnow

Mirai S 70 tok/s, 262k context, 12GB GPU

Mirai S from Mirai Labs is stronger and faster than ever! This is my agentic workflow patch for 27b quants applied to Mirai on my RTX4070 - 12gb+ users get the full 262k context at 70tok/s AND the agentic improvement patch! - 16gb+ users get all of these AND all positions in vram so even better num…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-09 17:43 · r/LocalLLM
    Mirai S 70 tok/s, 262k context, 12GB GPU

More stories

  1. GPT-6 and Intelligent UI for everyone — OpenAI News
  2. Introducing Claude Haiku 5.5 on AWS — AWS Machine Learning Blog
  3. OpenAI Decisions API now available on AI Gateway — Vercel Blog
  4. Philadelphia police say Anthropic AI submitted a "false homicide tip" — CBS News Technology
  5. NVIDIA, Microsoft Kick Off a New Beginning for Windows PCs With RTX Spark and AI Agents — NVIDIA Blog
  6. Introducing Playground: Create and play custom games — Google AI Blog
  7. Anthropic bans 'sustained and needless abusive or cruel behavior' toward its AI models — Engadget
  8. Scoop: AI companies plot "day after" scenarios for public revolt — Axios AI+

Get the daily brief of stories like this at 6:30 every morning →