Distribution Shift
Standard generalization guarantees in machine learning rely heavily on the independent and identically distributed (IID) assumption. If this assumption is relaxed—meaning that the underlying data distributions shift between the training phase and the testing phase—then no claims can be made about the model's ability to generalize to new data unless additional assumptions are established. Specifically, if the training data is sampled from a distribution and the test data from a different distribution , learning a robust classifier is impossible absent any assumptions on how the distributions relate. Fortunately, under restricted assumptions about the shift, principled algorithms can detect and adapt to changes.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Related
Learn After
Arbitrary Distribution Shift
Covariate Shift
Label Shift
Concept Shift
Nonstationary Distribution
Self-Driving Cars Example of Distribution Shift
Tank Detection Example of Distribution Shift
Face Detection Example of Distribution Shift
Web Search Example of Distribution Shift
Class Imbalance Example of Distribution Shift