Explain why a better reference is enough for this comparison test.
Question: In a concise analytical response, explain why a human demonstration path can still be useful in a comparison test even if it is not the best possible path.
Sample answer: A human demonstration does not need to be globally optimal for the comparison test to be useful. It only needs to be better than the current system output. If the demonstration outperforms the model, the comparison can still reveal whether the main limitation is in the search or optimization method, or in the scoring rule. That makes a superior reference sufficient for deciding what to improve next.
Key points:
- The reference can be good without being optimal.
- It must outperform the current model output.
- A superior reference is enough for the test.
- The result helps decide whether to improve search or scoring.
Rubric: A strong response explains the difference between superior and optimal, connects the human demonstration to the current system's performance, and states how the comparison guides the next improvement choice.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which property should a human reference trajectory have in optimization verification?
A verification comparison output must be provably optimal.
The candidate output must be _____ when compared with the current model's output.
Match each optimization verification term with its meaning.
Order the steps for using a human demonstration that is better than the current policy output.
Explain why a better reference is enough for this comparison test.
Can a better human route serve as the reference in Optimization Verification?
Required Quality of the Verification Target
If a human-produced solution is strong but not perfect, what can it still be used for?
A stronger-than-baseline result can still help decide what to improve.