Learn Before
Out-of-Bag Error Estimation
Out-of-Bag (OOB) observations give way to estimating the test error of a bagged model without cross-validation. OOB means that the observations were not used to fit a given bagged tree. Using the trees that included OOB observations, it is possible to predict the response for the th observation, which returns close to predictions. In the case of regression trees, these predictions can then be averaged in order to obtain a single prediction for the th observation. With classification trees, the single prediction for the th observation can be found by taking a majority vote. As a result, the OOB prediction can be used to estimate error; with regression trees, the overall OOB MSE can be found, and similarly, classification error for classification trees.
0
3
Contributors are:
Who are from:
Tags
Data Science