Learn Before
Code
Scalar Quadratic Gradient Descent Convergence Visualization
The convergence dynamics of gradient descent on a scalar quadratic function can be visualized programmatically by plotting the decay term over successive time steps . For instance, fixing the learning rate at and iterating over a set of curvature values (such as ) produces distinct trajectory curves. These plots practically reveal that values satisfying yield smooth exponential decay, values where exhibit oscillatory but converging behavior, and values approaching the theoretical limit of show dangerously slow convergence before divergence occurs.
0
1
Updated 2026-05-15
Tags
D2L
Dive into Deep Learning @ D2L