Why not just have one less feature before softmax? [D]
Softmax has N inputs and N outputs but it's output only has N-1 degrees of freedom because of the condition that the sum of outputs must be equal to one. Based on this we can figure out that actually we can make due with only N-1 inputs by making an assumption that logits before softmax must sum up…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-09-29 05:26 · r/MachineLearning
Why not just have one less feature before softmax? [D]