Explain why the doctor team's result is a better proxy than an individual doctor's result.
Question: In a concise analytical response, explain why 2% error should be used instead of 5% or 10% when estimating the optimal error rate and setting desired performance.
Sample answer: The 2% error achieved by the doctor team is the best demonstrated human performance among the available baselines. Therefore, 5% and 10% are too high as optimal-error proxies because humans can already do better. Using 2% also provides an achievable desired error rate. The true optimal error could be below 2%, but it cannot be above 2% because the team has demonstrated that level.
Key points:
- The doctor team achieves 2% error.
- The 5% and 10% baselines are worse than demonstrated team performance.
- The 2% result is a reasonable optimal-error proxy and desired level.
- The true optimal error may be lower than 2% but cannot be higher.
Rubric: A strong response identifies the doctor team as the best achievable human baseline, explains why 5% and 10% are too high, connects 2% to both the optimal-error proxy and desired performance, and preserves the distinction between a proxy and the true optimum.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which human baseline should define the optimal-error proxy for the x-ray diagnosis task?
True or false: The optimal error rate cannot be higher than the doctor team's 2% error.
The reasonable human-level performance proxy is _____ error.
Match each x-ray diagnosis baseline to its observed error rate.
Order the reasoning used to select a human-level performance proxy.
Explain why the doctor team's result is a better proxy than an individual doctor's result.
Choose the appropriate target when stakeholders propose a 5% x-ray diagnosis error rate.
Why does a 2% team error place an upper bound on the optimal error rate?
What conclusion is justified by the doctor team's 2% error?
True or false: Using 2% as a proxy means the true optimal error must equal 2%.