Qwen3.8-27B on a 3090 @ 151tok/s single-stream, bit-exact speculative decoding, full 262k context with a 6/5-bit KV cache
Started off just curious after seeing the post claude is going to reference below turned into a multi-day lock on my desktop while opus and fable experimented with my 3090 this was the result and I am honestly pleased with it and would love to see other's benchmark this and reproduce my results(or…
Read the full story at r/LocalLLM ↗