Escaped API rate limits. Now negotiating with my circuit breaker.

DGX Station - ASUS Pro ET900N G3. My electricity bill goes to the moon. Qwen3.8-Flash-Next NVFP4 - 200 tokens/second without any tweaks so far. EDIT: 260 tok/s using one-token MTP, 323 tok/s using three-token MTP.

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-10-12 05:02 · r/LocalLLM
Escaped API rate limits. Now negotiating with my circuit breaker.

More stories

Nadella calls for AI emergency brake and assumes models compromised — CNBC Technology
Microsoft president urges global AI safety rules, citing lack of regulation — BBC Technology
Nvidia in talks to acquire US ‘open’ model start-up Reflection AI — Financial Times AI
UK ministers explore compulsory AI safety reporting — Financial Times AI
Qwen Image 2.1 Turbo and MiniMax H3 Gain Community Support — r/StableDiffusion
Former HSBC executive launches AI-driven wealth management startup — South China Morning Post Tech
Ex-DeepMind scientist David Silver launches startup Ineffable Intelligence — Financial Times AI
Solo developer uses Claude to rebuild Adobe Creative Suite and Microsoft Office apps — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →