AINewsnow

What TPS is too slow for you?

I keep reading about extreme ends of TPS what people consider running their models at. Some are happy to run huge quality models at merely sub 30 tps, while others sacrifice/compromise the quality and pursue absolutely spectacular tps, often above 100-150. Where do you draw the line? Whats absolute…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-24 02:49 · r/LocalLLaMA
    What TPS is too slow for you?

More stories

  1. GPT-6 Sol and Luna now available on AI Gateway — Vercel Blog
  2. Bringing Private Processing to Meta AI Glasses — Engineering at Meta
  3. Gemini 3.8 text-to-speech models now available on AI Gateway — Vercel Blog
  4. Sam Altman’s remarks at the United Nations Security Council — OpenAI News
  5. Alibaba unveils new AI chip to challenge NVIDIA, plans Qwen models with up to 10 trillion parameters — Mint AI
  6. OpenAI Agent Hacked Australian Government Website — Wall Street Journal Technology
  7. AI Exchange — Financial Times AI
  8. How Benchling secured multi-tenant AI agents with Amazon Bedrock AgentCore — AWS Machine Learning Blog

Get the daily brief of stories like this at 6:30 every morning →