Learn Before
As plain networks grow deeper, their training accuracy can paradoxically worsen, a phenomenon known as the ___ problem.
0
1
Tags
Prep Sessions
Foundational Deep Learning Architectures: Transformers and Residual Networks @ University of Michigan - Ann Arbor
Ch.3 Deep Residual Network Architecture - Foundational Deep Learning Architectures: Transformers and Residual Networks @ University of Michigan - Ann Arbor
Residual Formulation and Shortcut Connections - Foundational Deep Learning Architectures: Transformers and Residual Networks @ University of Michigan - Ann Arbor
Related
Inductive Bias of Residual Connections
ResNet Function Decomposition
Residual Connections Enable Deeper ResNet Training
As plain networks grow deeper, their training accuracy can paradoxically worsen, a phenomenon known as the ___ problem.
Order the steps carried out during a forward pass in a residual block to compute the target function f(x) from an input x.
Explain why reformulating the layers to learn the residual mapping g(x) makes approximating the identity function f(x) = x easier for the network compared to learning f(x) directly.