Round 2: Nemotron 3.5 Bolt fits its full 256K context on one 3090, Qwen3.8 27B maxes out at 216K (VRAM + speed at 0/64K/128K fill)
Last time I posted Bolt vs Qwen3.8 27B on a 3090 and the top comment was basically "at 16K context, ok." While that wasn't the issue, I ran the same two files on the 3090 again and only changed the context size. Quick version: Bolt (NVIDIA's 2-bit 74B) loads its full native 256K with every layer on…
Read the full story at r/LocalLLM ↗