Essay

Explain why superiority, rather than optimality, is sufficient for this test.

Question: In a concise analytical response, explain why a human pilot trajectory can support Optimization Verification even when it is not optimal.

Sample answer: Optimization Verification can use the human pilot trajectory because the comparison output only needs to be superior to the current learning algorithm's output. T_human is assumed to be good, even if it is not optimal. Comparing against this superior y* can still indicate whether improving the optimization algorithm or improving the scoring function is the more promising direction.

Key points:

  • T_human may be good without being optimal.
  • The comparison output must outperform the current learning algorithm.
  • A superior y* is sufficient for Optimization Verification.
  • The test indicates whether optimization or scoring is more promising to improve.

Rubric: A strong response distinguishes superior from optimal, relates T_human to the current algorithm's performance, and states the improvement decision that the test can inform.

0

1

Updated 2026-07-20

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI