Gradient descent vs evolution on three loss landscapes
I've been getting a bit more into evolutionary algorithms again, so I was testing some loss landscapes where evolution beats vanilla gradient descent (while also trying to make some cool visuals). Round 1, rugged hillside: gradient descent gets stuck in a dip, and evolution reaches the bottom after…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-10-02 14:10 · r/deeplearning
Gradient descent vs evolution on three loss landscapes