Qwen 3.6 27b is "degenerate" in layer 3 of the J-space
Apologies if this is old news. I was playing around with the J-spaces of different models on jlens and Qwen 3.6's 3rd layer looks... well. Regardless of input, layer 3's top tokens are degenerate, in both senses of the word. Not exactly what I imagined when it flagged the first 1/3 layers as "degen…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-11 20:32 · r/LocalLLM
Qwen 3.6 27b is "degenerate" in layer 3 of the J-space