LiteMish: A Computationally Efficient and Smooth Algebraic Alternative to Mish
A while ago, I published a preprint proposing a novel approximation of the Mish activation function, which appears to be significantly more computationally efficient while preserving its learning capability. Interested to hear your thoughts. Paper: https://doi.org/10.36227/techrxiv.176591866.686980…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-09-28 17:58 · r/deeplearning
LiteMish: A Computationally Efficient and Smooth Algebraic Alternative to Mish