Gradient Descent (3D)

About this app

Loss surface of a real line fit in 3D: θ ← θ − η∇L with stability limit 2/λmax, two valleys and a saddle, GD, momentum and Adam racing, SGD noise and the fitted line in the model panel.

Subject: Neural networks

More from Neural networks

• Agent loop
• Attention Visualiser
• Backpropagation — blame in reverse
• Basin of Attraction
• Your job under AI
• The temperature dial
• Diffusion model — images from noise (3D)
• Embedding Space Explorer (3D)

A VisuApp by heyprof: interactive, free in your browser, no sign-up. What is a VisuApp? · All apps