Nemotron 3.5 Bolt 74B A9B - Anyone Using it?
I'm running Nemotron 3.5 Bolt 74B-A9B on a 5060 Ti 16GB and 32GB of DDR5. It's an MoE, so both of my setups split experts between the GPU and system RAM. I have two recipes: • 24GB GGUF • Unsloth UD-IQ3_XXS I'd like to hear how this model actually is and is it useful as an alternative for Qwen3.8 2…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-25 13:48 · r/LocalLLM
Nemotron 3.5 Bolt 74B A9B - Anyone Using it?