Relation

Relationship between Capacity, Training and Test Errors, Bias-Variance Tradeoff in Machine learning

Training and test error behave differently. At the left end of the graph, training error and test error are both high. This is the underfitting regime. As we increase capacity, training error decreases, but the gap between training and generalization error increases. Eventually, the size of this gap outweighs the decrease in training error, and we enter the overfitting regime, where capacity is too large, above the optimal capacity.

Image 0

0

2

Updated 2021-10-07

References


Tags

Data Science