Learn Before
Eyeball Dev Set May Be Omitted for Tasks Humans Cannot Do Well
If humans cannot do a task well, examining an Eyeball dev set may be less helpful because it is harder to determine why the algorithm misclassified an example; in that case, one might omit the Eyeball dev set.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Related
Detecting Eyeball Dev Set Overfitting by Comparing Performance Against the Blackbox Dev Set
Sizing the Eyeball Dev Set When Data Is Plentiful
Eyeball Dev Set Should Reveal Major Error Categories
Eyeball Dev Set May Be Omitted for Tasks Humans Cannot Do Well
What is the primary purpose of the Eyeball dev set when a large dev set is split into two subsets?
The name 'Eyeball dev set' is a reminder that a human manually looks at this portion of the dev set.
The Eyeball dev set is created by randomly selecting _____ of the dev set to be manually examined.
Match each term related to dev set splitting to its correct description.
Arrange the steps for creating and using an Eyeball dev set from a large dev set in the correct order.
If you take 10% of a 5,000-example dev set as your Eyeball dev set, how many examples does the Eyeball dev set contain?
A 500-example Eyeball dev set drawn from a 5,000-example dev set is expected to contain about 100 misclassified examples.
The Eyeball dev set should be large enough so that your algorithm misclassifies enough examples for you to _____.
Match each Eyeball dev set fact to the concept it illustrates.
Arrange the reasoning steps for deciding whether an Eyeball dev set is properly sized in the correct logical order.
Learn After
Why is an Eyeball dev set less helpful when humans cannot perform a task well?
An Eyeball dev set is equally useful regardless of whether humans can perform the task well.
When humans cannot do a task well, it is harder to figure out why the algorithm _____ an example correctly.
Match each scenario to the appropriate Eyeball dev set recommendation from Machine Learning Yearning.
Order the steps a practitioner should follow when deciding whether to include an Eyeball dev set.
A team builds a model to detect ultra-low-frequency seismic signals that no human can reliably identify. What should they do about the Eyeball dev set?
According to Machine Learning Yearning, practitioners might omit the Eyeball dev set when humans cannot perform the task well.
For tasks that humans cannot do well, you might _____ having an Eyeball dev set.
Match each concept to its definition in the context of Eyeball dev set decision-making.
Order the logical reasoning chain that explains why non-human-level tasks reduce the value of the Eyeball dev set.