Although deep learning frameworks assign default stride and padding values for pooling layers, both can be manually overridden to control the output dimensions. Padding adds extra border elements (typically zeros) to the input before pooling, allowing the pooling window to cover boundary regions. Setting the stride smaller than the window size introduces overlap between adjacent windows, whereas a larger stride increases the downsampling factor. These controls mirror the padding and stride mechanisms available in convolutional layers and are essential for achieving a desired output shape in network architectures.

Overriding Padding and Stride in Pooling Layers

On a $$ 4 \times 4 $$ input, applying a $$ (3, 3) $$ max-pooling layer with the default stride of $$ (3, 3) $$ produces a $$ 1 \times 1 $$ output. This output contains the maximum value of the top-left $$ 3 \times 3 $$ region, because the pooling window cannot shift further by $$ 3 $$ pixels without exceeding the input boundaries.

Example of Default Stride in a Pooling Layer

Unlike convolutional layers—where the default stride is $$ 1 $$—deep learning frameworks set the default stride of a pooling layer equal to the pooling window size. For example, specifying a pooling window of shape $$ (3, 3) $$ automatically sets the stride to $$ (3, 3) $$. This convention ensures that consecutive pooling windows do not overlap, so each input element contributes to exactly one output element.

Claude

Google

A pooling layer is configured entirely through hyperparameters rather than learned parameters. The key hyperparameters are the pooling window size (which can be specified as a single integer for a square window or as a tuple for a rectangular window with distinct height and width), the stride (the number of elements the window moves per step), the type of aggregation (max or average), and the amount of padding applied to the input borders. Because pooling computes a fixed, deterministic function—either the maximum or the average—there are no weight parameters to learn, and therefore no parameter initialization is needed. A widely adopted default configuration uses a $$2 	imes 2$$ pooling window, which quarters the spatial resolution of the output (halving both height and width), providing an effective balance between downsampling and information retention.

Learn Before

Related

Learn After