Learn Before
What makes a dev-set example mislabeled?
Question: In dev-set error analysis, what does it mean for an example to be mislabeled, which part of the pair (x, y) is wrong, and give a concrete example.
Sample answer: An example is mislabeled when the human-assigned target is wrong before the model ever sees it. In the pair (x, y), the label y is incorrect, while x is the input data. For instance, a medical X-ray showing no fracture could be marked as "fracture present," or an X-ray with a clear fracture could be marked as "no fracture."
Key points:
- The mistake is introduced by the person who labeled the data.
- The incorrect part of (x, y) is y, the label.
- A positive/negative example can be flipped incorrectly, such as fracture vs. no-fracture.
Rubric: The answer should explain that mislabeling is a human labeling error that exists before the algorithm processes the data. It must identify y as the incorrect component of (x, y). It must also give a concrete mislabeling example.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Adding a Mislabeled Column to Error Review
When to Repair Noisy Development Labels
Keep Validation and Test Label Fixes Aligned
In dev-set error analysis, what does it mean for an example to be mislabeled?
True or False: Mislabeled examples in a dev set are mistakes made by the model.
In a labeled example written as (x, _____), the second component is the target label.
Match each symbol in a mislabeled training example to its meaning.
Arrange the events that lead to finding a mislabeled validation example in a text classifier project.
What makes a dev-set example mislabeled?
Find the data problem in a traffic-sign classifier's dev set.
Where does a mislabeled dev example get its error?
Which option shows a mislabeled example in a wildlife image dataset used to classify birds?
True or False: In a mislabeled training example (x, y), the value y is wrong.