Learn Before
Mathematical Formulation of Curriculum Learning
Let be a random variable representing an example for the learner (possibly an pair for supervised learning). Let be the target training distribution from which the learner should ultimately learn a function of interest. Let be the weight applied to example at step in the curriculum sequence, with , and . The corresponding training distribution at step is . Consider a monotonically increasing sequence of values, starting from and ending at . The corresponding sequence of distributions is a curriculum if the entropy of these distributions increases, i.e., , and is monotonically increasing in , i.e., . This builds up a sequential training process where weights initially favor simpler examples that can be learned relatively easily. The training undergoes adaptation in weighting to increase the probability of difficult examples entering the training set, as a result of which the entropy increases.
0
1
Contributors are:
Who are from:
Tags
Data Science