Learn Before
What a learning curve shows
Question: Describe what a learning curve is in machine learning and explain why it is useful for model diagnosis.
Sample answer: A learning curve is a graph that shows how a model’s validation or development error changes as the number of training examples increases. One axis represents the amount of training data, and the other axis represents error on held-out data. It is useful because it helps practitioners see whether extra data is still improving the model, whether progress has started to flatten out, and whether the model’s behavior suggests a data, bias, or variance problem.
Key points:
- Horizontal axis: number of training examples
- Vertical axis: dev-set or validation error
- Useful for judging how performance changes as training data grows
Rubric: The student must identify the two axes of a learning curve and explain how the graph helps diagnose model behavior.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Constructing a Performance Curve from Different Training Set Sizes
Larger Training Sets Usually Lower Dev-Set Error
Target Error Rate on a Learning Curve
Using a Development-Set Curve to Estimate the Payoff of More Data
Using Training Error to Judge the Value of More Data
Why plot training and development error together on a learning curve?
Tiny Training Samples Make Learning Curves Unstable
What are the axes of a learning curve?
A learning curve shows error versus network depth.
Learning Curves and Validation Error
Parts of a learning curve
Constructing a learning curve for model selection
What a learning curve shows
Using a learning curve to judge whether more data will help
What a Learning Curve Shows
What belongs on the vertical axis of a learning curve?
A learning curve is less informative than a single validation score.