Human-label tasks for estimating the best possible error
Question: According to the lesson, what are two example tasks that people can do well enough to use human labels when estimating the optimal error rate?
Sample answer: Two examples are identifying common objects in clear photographs and transcribing short, clean speech clips.
Key points:
- Identifying common objects in clear photographs
- Transcribing short, clean speech clips
Rubric: Award full credit if the student gives both examples of tasks that humans can perform reasonably well.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Using Human Performance to Estimate the Best Possible Error
What does comparing human labels with the training set estimate?
Human Labels Can Help Estimate the Best Achievable Error Rate on Easy Human Tasks
Estimating the Best Human-Level Error on an Easy Task
Match each term to the description that fits a human-label-based estimate of the best possible error rate.
Arrange the steps for estimating the best achievable error rate from human labels.
Which pair of tasks is most suitable for using human labels to estimate a practical lower bound on error?
Human Label Accuracy Is Checked Against the Training Set
Human-Friendly Labeling Tasks
Match each step in the human-label estimate procedure to what it is for.
Order the logic for using human labels as a proxy for the best achievable error rate.
Using Human Labels to Estimate Best-Possible Error
Estimating an Error Floor for Bird Photo Classification
Human-label tasks for estimating the best possible error