Tasks hindering optimal error rate estimation
Question: According to the text, name two specific examples of tasks where human difficulty makes it hard to estimate the optimal error rate.
Sample answer: Two examples are predicting what movie to recommend and predicting what ad to show to a user.
Key points:
- Predicting what movie to recommend.
- Predicting what ad to show to a user.
Rubric: The answer must list both predicting movie recommendations and predicting ad displays.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Problems Where Humans Perform Poorly Have Weaker Human-Level Baselines
Which characteristic of a task makes it difficult to estimate the optimal error rate, per Machine Learning Yearning?
Predicting what movie to recommend is cited in Machine Learning Yearning as a task where even humans have a hard time.
For tasks that even humans find hard, estimating the _____ error rate is especially difficult.
Match each concept to its correct description regarding optimal error rate estimation.
Order the steps for assessing whether human performance can guide your optimal error rate target.
Which task does Machine Learning Yearning specifically name as an example where human difficulty makes optimal error rate estimation hard?
Human-level performance is always a reliable proxy for the optimal error rate, regardless of whether humans can do the task well.
Alongside movie recommendation, Machine Learning Yearning cites predicting what _____ to show a user as a task even humans find difficult.
Match each scenario to its implication for optimal error rate estimation.
Order the reasoning steps when working on a task where even humans have a hard time.
Consequences of human difficulty on error rate targets
Setting baselines for an ad recommendation engine
Tasks hindering optimal error rate estimation