Learn Before
A useful human output for optimization verification
Optimization verification does not depend on having a perfect reference output. If you can obtain a human-produced result that is clearly better than the current model output, it can still serve as the comparison point. That comparison can reveal whether the main problem is the optimization procedure or the scoring objective, even when the human result is not globally optimal.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Classifying development-set mistakes with optimization verification
Approximate Scoring Followed by Approximate Search
Checking Whether a Translation Error Comes from Search or Scoring
Checking Reward Quality in Reinforcement Learning
A useful human output for optimization verification
What does this optimization check suggest when the reference candidate scores higher than the algorithm’s output?
Using the Optimization Verification Test
Optimization Check Symbols
How to carry out an optimization verification check
Using the Optimization Verification Check
Debugging a Translation Decoder
When to Attribute an Error to Optimization
When Is an Optimization Check Useful?
Checking the Source of a Performance Problem
Optimization checks can isolate the source of a training problem
Learn After
Which property should a human reference trajectory have in optimization verification?
A verification comparison output must be provably optimal.
The candidate output must be _____ when compared with the current model's output.
Match each optimization verification term with its meaning.
Order the steps for using a human demonstration that is better than the current policy output.
Explain why a better reference is enough for this comparison test.
Can a better human route serve as the reference in Optimization Verification?
Required Quality of the Verification Target
If a human-produced solution is strong but not perfect, what can it still be used for?
A stronger-than-baseline result can still help decide what to improve.