Gradient Descent Reference

Linear Regression and Gradient Descent

Numerical Approximation of Gradients

Gradient Checking

Why Gradient descent might fail?

A Chat with Andrew on MLOps: From Model-centric to Data-centric AI

Big Data to Good Data: Andrew Ng Urges ML Community To Be More Data-Centric and Less Model-Centric

MLOps: Data-centric and Model-centric approaches

Critical Points

First-order Optimization Algorithm

Method of Steepest Descent

Second-Order Gradient Methods

Gradient Descent Variants

Notes about gradient descent

Suppose you have built a neural network. You decide to initialize the weights and biases to be zero. Which of the following statements is true?

Vanishing/exploding gradient

BERT Training Process

Scoring Rule Problem

The Problem with Constant Initialization

Objective Function Change Bounds in Gradient Descent

One-Dimensional Gradient Descent

Multivariate Gradient Descent

Second-Order Optimization Algorithm

Average Objective Function in Deep Learning

Accelerated Gradient Methods

Batch Gradient Descent Update Formula

Distributed Deep Learning Training

Optimal Step Size for Gradient Descent via Taylor Expansion

Gradient Descent Intuition