The region proposal network (RPN) is an internal component of Faster R-CNN that generates region proposals by processing CNN-extracted feature maps in four steps. First, a $$3 	imes 3$$ convolutional layer with a padding of $$1$$ transforms the feature maps into a new output with $$c$$ channels, providing a length-$$c$$ feature vector for each spatial unit. Second, multiple anchor boxes of varying scales and aspect ratios are generated and centered on each pixel. Third, these length-$$c$$ feature vectors are used to predict a binary class (object or background) and a bounding box for each anchor box. Finally, non-maximum suppression is applied to the bounding boxes predicted as objects to remove overlapping results, yielding the final region proposals required by the region of interest pooling layer.

Region Proposal Network

The mask R-CNN is an extension of the faster R-CNN object detection architecture. It is designed to effectively leverage detailed pixel-level labels in a training dataset to further improve object detection accuracy. By modifying the base architecture, mask R-CNN is capable of predicting both traditional bounding boxes and the precise pixel-level positions of objects.

Mask R-CNN

To reduce the number of region proposals without losing accuracy, the Faster R-CNN model improves upon the Fast R-CNN architecture by replacing the external selective search algorithm with an internal region proposal network (RPN). Aside from this change in the region proposal method, the rest of the object detection pipeline remains identical to Fast R-CNN.

Claude

The Fast R-CNN model is an evolution of the R-CNN architecture designed to address its primary performance bottleneck: independent convolutional feature extraction for thousands of overlapping region proposals. Instead of processing each region proposal individually, Fast R-CNN performs a single CNN forward propagation on the entire input image to produce a global feature map. Because computation is shared across all region proposals, this approach eliminates redundant processing and significantly accelerates object detection.

Fast R-CNN

Dive into Deep Learning

The Fast R-CNN model processes an image through four major computational steps. First, a trainable CNN extracts features from the entire image, outputting a feature map of shape $$1 	imes c 	imes h_1 	imes w_1$$. Second, selective search generates $$n$$ region proposals, which are mapped as regions of interest on the CNN output. A region of interest (RoI) pooling layer then extracts concatenated features of a uniform shape $$n 	imes c 	imes h_2 	imes w_2$$ from these proposals. Third, a fully connected layer transforms these features into a matrix of shape $$n 	imes d$$. Finally, the output is transformed into a shape of $$n 	imes q$$ for object class prediction using softmax regression (where $$q$$ is the number of classes) and a shape of $$n 	imes 4$$ for bounding box prediction.

Learn Before

Related

Learn After