AINewsnow

Mercury 3 Does 1,068 Tokens/Second With a Diffusion LLM — Here's the Architecture Trick (and How to Try It)

This story is from 2026-10-20. It is preserved in the archive; the latest stories are on the live feed.

Today Inception Labs dropped Mercury 3 : a diffusion-based LLM with a 1M-token context window doing 1,068 tokens/sec on NVIDIA GPUs , claiming to beat GPT-6 Luna and Claude Haiku 5.5 on benchmarks — at $0.20/$0.70 per million tokens, half price during launch. It's live on OpenRouter, Baseten, Verce…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-20 04:35 · DEV Community — Machine Learning
    Mercury 3 Does 1,068 Tokens/Second With a Diffusion LLM — Here's the Architecture Trick (and How to Try It)

More stories

  1. Inception launches Mercury 3, a diffusion LLM it claims tops GPT-6 Luna, Claude Haiku 5.5, and GLM-5.3 Flash on agentic benchmarks while being 4x to 8x faster — Techmeme
  2. deepseek-ai/DeepSeek-V4.1-Flash-1017 · Hugging Face — r/LocalLLaMA
  3. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLaMA
  4. How to get better response? — r/GeminiAI
  5. I want to use different IA models (Claude, OpenIA, etc) but i want to pay just one suscription. Any recommendations? — r/AI_Agents
  6. White pill: Gemini is better at engineering tasks then ChatGPT — r/GeminiAI
  7. Tried out Gemini 4 Argon Medium on Antigravity. Burnt 66% of its WEEKLY quota and performed worse than both GPT 6.1 Sol Medium and Claude 5.5 Opus Medium — r/GeminiAI
  8. NPCs can talk back now | from universal modder on X: "Introducing NPCTalk: make the NPCs of any game talk in realtime. I made every NPC in GTA V answer to me in character, in their own cloned voice, in under 1s, and they act on what you say. — r/agi

Get the daily brief of stories like this at 6:30 every morning →