AINewsnow

Flint vs Ornith vs Nemotron MoE on RTX PRO 6000, orchestrated by Opus

Quick context: I let a cloud model (Opus 5.5) plan, and three copies of a local model do the actual coding in parallel. Then I swapped only the local model across three runs: Flint 40B-A2.5B, Ornith 1.5 35B-A3B, Nemotron 3.5 Lightning 30B-A3B. All Q8_0 GGUF, llama.cpp b11803, --parallel 3 , 64K con…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-23 00:39 · r/LocalLLM
    Flint vs Ornith vs Nemotron MoE on RTX PRO 6000, orchestrated by Opus

More stories

  1. Qwen3.8-Flash-Next vs Opus 5.5: Six-way benchmark on a real Rust feature with Claude Code and Pi — r/LocalLLaMA
  2. vLLM KV Cache Math: Why My 24GB GPU Served Only 4 Requests at Once — DEV Community — Machine Learning
  3. A local NotebookLM that edits your files, built on llama.cpp — r/LocalLLM
  4. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA
  5. A TypeScript-only Qwen3.6-35B that runs at 36 tok/s on a 16 GB Mac — r/huggingface
  6. Ling-3.0-tiny-UBTree DFlash draft for stock mainline llama.cpp (+8% prose, +61% code speedup) — r/LocalLLaMA
  7. Q4 flash next for £300/600 👀 - snapdragon mini PC results update - 315/43 Tok/s A3b, 46/20 Tok/s Flash Next (read/gen) 💥 — r/LocalLLaMA
  8. Llama Proxy Cache v0.6.0 for llama-server prefill KV cache management — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →