AINewsnow

OpenRouter served NVIDIA's own model faster than NVIDIA did

This story is from 2026-09-02. It is preserved in the archive; the latest stories are on the live feed.

While benchmarking free AI APIs I ran the identical model — nemotron-3-super-120b , NVIDIA's own — on two endpoints: NVIDIA's own API : 7.6 s to first token, 36.7 tok/s OpenRouter's free tier : 2.7 s to first token, 45.7 tok/s Same weights. Same request. Different serving infrastructure. I'd assume…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-09-02 09:26 · DEV Community — AI
    OpenRouter served NVIDIA's own model faster than NVIDIA did

More stories

  1. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  2. Building an open-source 500+ language Sparse MoE translation model from scratch (Apache 2.0) — r/huggingface
  3. Huawei details AI accelerator roadmap, pulls in next-generation Ascend NPUs by several quarters — FP4 performance of the Ascend 960PR doubles expectations — Tom's Hardware
  4. Flyweight: open-source C++/CUDA engine for running MoE models bigger than your VRAM on one GPU + system RAM. First PyPI release, looking for contributors. — r/LocalLLaMA
  5. Running Qwen3.8-Flash-Next ~85GB GGUF on 2× RTX 3060 12GB: ~12 tok/s, 131k ctx, CPU MoE, and a 26.5k agent prompt — r/LocalLLM
  6. Built a home server from an old PC with GPU upgrade. Qwen3.8 27B runs at ~30 tokens per second. — r/LocalLLaMA
  7. FREE AI TRAINING CREDIT — r/learnmachinelearning
  8. No one is surprised that Nvidia's Jensen Huang thinks AI fears are overblown. — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →