Learn Before
Find the data problem in a traffic-sign classifier's dev set.
Case context: You are training a traffic-sign classifier. During dev-set error analysis, you find a photo that clearly shows a stop sign. Your model predicts "stop sign" correctly, but the example is counted as an error because the dev-set label says "yield sign".
Question: What is the data issue here? Name the type of problem, explain who introduced it, and identify which part of the labeled pair (x, y) is wrong.
Sample answer: This is a mislabeled example. The mistake was introduced by a human annotator before the model saw the data. In the pair (x, y), the input x is the traffic-sign image, and the incorrect part is the label y, which should have been "stop sign" instead of "yield sign".
Key points:
- The issue is a mislabeled example.
- The error came from a human labeler before model training or evaluation.
- The incorrect component of (x, y) is the label y.
Rubric: The response must identify the example as mislabeled. It must state that a human annotator introduced the error before the algorithm saw the data. It must also specify that y, not x, is the incorrect part of the pair.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Adding a Mislabeled Column to Error Review
When to Repair Noisy Development Labels
Keep Validation and Test Label Fixes Aligned
In dev-set error analysis, what does it mean for an example to be mislabeled?
True or False: Mislabeled examples in a dev set are mistakes made by the model.
In a labeled example written as (x, _____), the second component is the target label.
Match each symbol in a mislabeled training example to its meaning.
Arrange the events that lead to finding a mislabeled validation example in a text classifier project.
What makes a dev-set example mislabeled?
Find the data problem in a traffic-sign classifier's dev set.
Where does a mislabeled dev example get its error?
Which option shows a mislabeled example in a wildlife image dataset used to classify birds?
True or False: In a mislabeled training example (x, y), the value y is wrong.