Learn Before
Concept

Out-of-Bag Error Estimation

Out-of-Bag (OOB) observations give way to estimating the test error of a bagged model without cross-validation. OOB means that the observations were not used to fit a given bagged tree. Using the trees that included OOB observations, it is possible to predict the response for the iith observation, which returns close to B/3B/3 predictions. In the case of regression trees, these predictions can then be averaged in order to obtain a single prediction for the iith observation. With classification trees, the single prediction for the iith observation can be found by taking a majority vote. As a result, the OOB prediction can be used to estimate error; with regression trees, the overall OOB MSE can be found, and similarly, classification error for classification trees.

0

3

Updated 2020-03-06

Tags

Data Science

Learn After