Learn Before
Use labeled data to fit the model, not to score it
Case context: A research group collects pictures of ripe and unripe apples from several orchards. It labels ripe fruit as class 1 and unripe fruit as class 0, but then leaves the whole collection unused because it thinks any dataset must be protected until the final check.
Question: What mistake has the group made, and how should it handle these pictures?
Sample answer: The group is mixing up data used for fitting a model with data used for judging it. The labeled apple pictures should be combined into a training collection so the model can learn from them and update its parameters. A separate test collection should be kept aside and used only after training to measure performance.
Key points:
- The collected pictures can be used as training data.
- Ripe apples are the positive class.
- Unripe apples are the negative class.
- The model should be fit using the training data.
- Test data should stay reserved for evaluation.
Rubric: The response should identify the confusion between training data and test data and explain that the labeled pictures belong in model fitting, while the test data must remain held out for evaluation.
0
1
Tags
Deep Learning
Data Science
D2L
Dive into Deep Learning @ D2L
Machine Learning
Supervised Learning
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Nonparametric Models
Fashion-MNIST Dataset
Definition of Realizable Dataset
What does a training set do in supervised learning?
The training set is used only for final evaluation.
Dataset Used for Model Fitting
Match each dataset concept with its correct description.
Order the steps for building an image training set.
Different Purposes of Training and Test Data
Use labeled data to fit the model, not to score it
What role does a training set play in model training?
Which data split should be used to update the model’s weights?
A training set can contain examples from both classes in a binary classification task.