AINewsnow

Why your local LLM tok/s numbers don't match mine

A few weeks ago I needed to pick a local inference server for a project. I'm on a Mac, so the candidates were the usual ones: Ollama, LM Studio, a couple of MLX servers. I did what everyone does and went looking for benchmarks. I found plenty. I just couldn't reproduce any of them. One post said se…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-11-10 09:35 · DEV Community — AI
    Why your local LLM tok/s numbers don't match mine

More stories

  1. Anthropic launches Claude Fable 5.2 and Mythos 5.2 with coding gains and 20% price cut — Anthropic (X)
  2. Meta expands AI age-estimation globally to extend Instagram Teen Account protections — Meta Newsroom
  3. Nvidia board probes CEO Jensen Huang over affair with alleged Chinese spy — Axios AI+
  4. Australia to create AI safety regulator after OpenAI agent breached government portal — Barron's
  5. Meta launches Muse Ember, a low-cost AI model aimed at high-volume agent work — TechCrunch AI
  6. Qantas to cut 850 Australian jobs and outsource work to India in AI-driven overhaul — The Guardian AI
  7. Anthropic to Begin Formal IPO Marketing After Filing Misstep — Wall Street Journal Technology
  8. Instagram launches Effect Builder, an AI tool for creating Stories filters from text prompts — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →