Question: Explain why the Optimization Verification test is necessary in machine translation. Describe the two main components of the system that the test evaluates and how it distinguishes between their failures.

Sample answer: In machine translation, the set of all possible English sentences is too large to score exhaustively, so systems use both a scoring function to evaluate translations and a heuristic search algorithm to find high-scoring sentences. When the system outputs an incorrect translation, the Optimization Verification test is necessary to pinpoint which component failed. It does this by comparing the score of the correct translation to the score of the incorrect output. If the correct translation has a higher score, the scoring function worked, but the search algorithm failed to find it. If the incorrect output has a higher or equal score, the scoring function is at fault for ranking the bad translation higher.

Key points:

• Identifies the scoring function and heuristic search algorithm.
• Explains that heuristic search is needed due to the massive set of possible translations.
• Describes the condition where the search algorithm is blamed (Score(E*) > Score(Eout)).
• Describes the condition where the scoring function is blamed (Score(E*) <= Score(Eout)).

Rubric: The essay should identify the two main components (scoring function and heuristic search), explain why heuristic search is used (large search space), and detail the logic of comparing the scores of the correct and incorrect translations.