Learn Before
Example
Multivariate Gradient Descent on a Two-Dimensional Quadratic
To demonstrate multivariate gradient descent in practice, consider the two-dimensional objective function with input . Its gradient is . Starting from the initial point and applying the update rule with a learning rate of for iterations, the trajectory of converges steadily toward the minimum at . After steps the parameters reach approximately and , confirming well-behaved but relatively slow convergence. The contour plot of shows elliptical level curves (elongated along ) because the curvature in the direction is twice that in , which causes to converge faster than .
0
1
Updated 2026-05-15
Tags
D2L
Dive into Deep Learning @ D2L