Learn Before
Using a Superior Human Output in Optimization Verification
Optimization Verification does not require a truly optimal output. If a superior output is available, such as a human pilot trajectory that is better than the current learning algorithm output, the test can still indicate whether improving the optimization algorithm or the scoring function is more promising.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Applying Optimization Verification Across Dev Set Errors
Approximate Scoring Function Plus Approximate Maximization Pattern
Optimization Verification for Machine Translation
Optimization Verification for Reinforcement Learning Reward Functions
Using a Superior Human Output in Optimization Verification
Diagnosing Errors with Optimization Verification
To apply the Optimization Verification test for a given input , you must know how to compute a _____ that indicates how good a response is to that input.
Optimization Verification Variables
Steps to Perform Optimization Verification
Interpreting the Test Outcomes
Speech Recognition Debugging
Condition for Blaming Optimization
Preconditions for Optimization Verification
Applicability of the Test
Purpose of Optimization Verification for Optimization Verification Test
Learn After
What makes a human pilot trajectory suitable for Optimization Verification?
Optimization Verification requires a provably optimal comparison output.
The comparison output must be _____ to the current algorithm's output.
Match each Optimization Verification concept with its role.
Order the reasoning for using a non-optimal human trajectory.
Explain why superiority, rather than optimality, is sufficient for this test.
Should a better human trajectory be used when no optimal trajectory is known?
What minimum property must y* have in Optimization Verification?
What conclusion is justified when T_human is good but not optimal?
A better-than-current output can guide the optimization-versus-scoring decision.