Receptive Field and Parameter Efficiency of Stacked Convolutions
Stacking multiple small convolutions can achieve an equal or larger receptive field compared to a single large convolution, while improving parameter efficiency and increasing network depth. For example, applying two successive convolutions covers the same receptive field as a single convolution. While a single convolution requires parameters (where is the number of channels), three successive convolutions provide an even larger receptive field while using a comparable number of parameters (). This efficiency demonstrates that deep and narrow networks significantly outperform shallow and wide counterparts, establishing stacked convolutions as a standard architectural design.
0
1
Tags
D2L
Dive into Deep Learning @ D2L