AINewsnow

Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.

i Got a bit obsessed with my P40 this week trying to max speed on Ornith 1.5 35B-A3B (qwen3.5 MoE arch) without going below Q4 weights or q8 KV. Shrinking quants to win a benchmark has not really been useful to me so ai wanted a logical middle ground that was still “fast” Setup: one Tesla P40 24GB…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-28 10:58 · r/LocalLLaMA
    Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.

More stories

  1. How I think Tesla's flying car will be at launch (created with Seedance 2,0 through DavinciAI) — r/aivideo
  2. ‘Meaningless as a laptop screensaver’: reviewers slate Musk’s AI-made Odyssey film — The Guardian AI
  3. Tesla gave up the EV crown. Now it wants to win the autonomy race. — Ars Technica AI
  4. ANOTHER Flying Car? (Not Tesla / Not AI) — Matt Wolfe
  5. Tesla owner just flew away in his car, made with dreamina — r/aivideo
  6. This Tesla Actually Flies (NOT AI) — Matt Wolfe
  7. NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt — Hugging Face Blog
  8. Anthropic reveals plans for blockbuster IPO — Sky News Technology

Get the daily brief of stories like this at 6:30 every morning →