Essay

Explain why a better reference is enough for this comparison test.

Question: In a concise analytical response, explain why a human demonstration path can still be useful in a comparison test even if it is not the best possible path.

Sample answer: A human demonstration does not need to be globally optimal for the comparison test to be useful. It only needs to be better than the current system output. If the demonstration outperforms the model, the comparison can still reveal whether the main limitation is in the search or optimization method, or in the scoring rule. That makes a superior reference sufficient for deciding what to improve next.

Key points:

  • The reference can be good without being optimal.
  • It must outperform the current model output.
  • A superior reference is enough for the test.
  • The result helps decide whether to improve search or scoring.

Rubric: A strong response explains the difference between superior and optimal, connects the human demonstration to the current system's performance, and states how the comparison guides the next improvement choice.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI