Learn Before
How Informal Bias Relates to Training Error
Question: In an informal discussion of machine learning, how is bias described, and why does the size of the training set matter?
Sample answer: A common informal description of bias is the model's error on the training data. When the training set is very large, that training error is used as a rough approximation of the model's bias.
Key points:
- Bias is described informally as training error.
- With a very large training set, training error serves as a rough stand-in for bias.
Rubric: The response must say that bias is informally described by the model's error on the training data, and that this is only a rough approximation when the training set is very large.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
High Training Error Calls for Better Fit, Not More Data
Low Bias and Low Variance Mean Good Performance
A Negative Gap to the Best Achievable Error Usually Signals Memorization
Informal and Technical Uses of Bias and Variance
Training Performance Is a Baseline for Held-Out Performance
Informal Meaning of Model Bias
True or False: In this framework, the term bias refers to a model’s error on the validation or test set.
Informal meaning of bias in a large-sample setting
Informal Meaning of Bias
In this informal usage, bias means the model's error on the training set.
Informally, an algorithm's _____ is the error rate on the training set.
Match each learning-curve term to its meaning.
Order the steps for estimating bias from training error.
Why use a very large training set when estimating bias?
Bias Is Measured on the Holdout Set
In the large-sample limit, bias is typically assessed on the _____ data.
Match each learning-term description with its role in the informal bias definition.
Order the steps for deciding whether bias is the main cause of poor model performance.
Interpreting Training Error on a Large Dataset
Informal Bias and Training Error