Learn Before
Concept
Newton's Method
Newton's Method is a second-order optimization algorithm that relies on the second-order Taylor expansion of a multivariate function . By taking the expansion , where is the Hessian matrix, and setting the derivative with respect to the update step to zero (), the algorithm derives the optimal update step as . This approach requires computing and inverting the Hessian matrix to directly jump toward the function's minimum.
0
1
Updated 2026-05-15
Contributors are:
Who are from:
Tags
Data Science
D2L
Dive into Deep Learning @ D2L