← All Modules / Module 1 / Session 1.4

Gradient Descent Simulator

Watch gradient descent navigate loss landscapes with different learning rates

Interactive Controls

0.01
0.00
Current Loss
0
Steps Taken

How to Use

1. Choose a loss landscape above

2. Adjust the learning rate slider

3. Click on the landscape to set starting position

4. Press "Start" to watch gradient descent in action!

Key Insights

  • Click the landscape to set a starting position
  • Try different learning rates to see their effects
  • Watch how the ball follows the gradient downhill

Loss Landscape Visualization

Understanding Gradient Descent

  • Gradient: The direction of steepest increase (uphill)
  • Descent: Move in opposite direction (downhill)
  • Learning Rate: How big steps to take
  • Convergence: Eventually reaches minimum (low loss)
  • Local Minima: Can get stuck in valleys