What condition identifies a scoring-function error in optimization verification?
Question: In the Optimization Verification test, what mathematical condition indicates that a dev set error is a scoring-function error rather than an optimization-algorithm error?
Sample answer: A scoring-function error is identified when , where is the correct target output and is the algorithm's output.
Key points:
- State the inequality condition .
- Identify that this inequality marks the error as a scoring-function error.
Rubric: The response must state the inequality and clarify that this condition represents a scoring-function error.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Related
Prioritizing Scoring Improvements from Optimization Verification Counts
When applying the Optimization Verification test to a dev set error, which condition marks the error as caused by the optimization algorithm?
True or False: When Score_A(S*) ≤ Score_A(S_out) for a dev set error, the error is attributed to the optimization algorithm.
Each dev set error where Score_A(S*) ≤ Score_A(S_out) is counted as a mistake due to the _____.
Which condition classifies a dev set error as an optimization-algorithm error in the Optimization Verification test?
The Optimization Verification test should be applied to every error in the dev set, not just a single example.
When Score_A(S*) ≤ Score_A(S_out), the dev set error is classified as a _____ error.
Match each Optimization Verification inequality or symbol to its correct interpretation.
Order the steps for applying the Optimization Verification test across all errors in the dev set.
What does the condition Score_A(S*) ≤ Score_A(S_out) reveal about a dev set error?
Andrew Ng's Optimization Verification discussion initially focused on a single example before scaling the approach to the full dev set.
In the Optimization Verification test, S* represents the _____ output for a given input.
Match each Optimization Verification concept to its role in diagnosing dev set errors.
Order the decision-making steps after tallying Optimization Verification results across the dev set.
How should you partition dev set errors using the Optimization Verification test?
Diagnosing Dev Set Errors Using Optimization Verification Inequalities
What condition identifies a scoring-function error in optimization verification?