Learn Before
Explain what beta = 1/40 does when mixing two training pools
Question: In a concise analytical response, explain what beta = 1/40 changes in the training objective and why the dev set still matters when choosing beta.
Sample answer: Beta controls the contribution of a supplemental collection of 160,000 examples in the loss. In an objective that also uses 4,000 core examples, setting beta = 1/40 gives the supplemental collection the same total weight as the core collection, because 160,000 × 1/40 = 4,000. That is only one possible setting; beta should still be treated as a tunable hyperparameter and chosen using dev-set performance.
Key points:
- Beta scales the contribution of the supplemental data.
- The example compares 4,000 core examples with 160,000 supplemental examples.
- Beta = 1/40 makes the two collections equal in total influence.
- Beta is still selected by checking which value works best on the dev set.
Rubric: A strong response identifies what beta weights, explains why 1/40 equalizes the total contribution in this example, and states that beta should be tuned on the dev set rather than assumed to be fixed.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which beta value gives the two image collections equal total weight?
Does beta set how much the auxiliary image set influences the total loss?
Setting beta to _____ makes the two data collections contribute the same total weight.
Match each part of the weighted loss to its role.
Order the steps for setting the auxiliary-data weight.
Explain what beta = 1/40 does when mixing two training pools
Interpreting beta when two data sources differ in size
Why can beta = 1/25 balance collections of very different sizes?
How should you choose a different mixing coefficient?
A tuning constant for auxiliary data must always be set to 1/50.