Case context: A speech-to-text system is asked to transcribe the audio for "the green light is on." The intended transcript is S*. The decoder returns a different candidate, S_bad. An engineer evaluates Score_B(S*) and Score_B(S_bad) and finds that Score_B(S*) < Score_B(S_bad).

Question: Using an optimization verification check, what does this tell you about the source of the problem, and what should the engineer focus on next?

Sample answer: The inequality Score_B(S*) < Score_B(S_bad) shows that the issue is in the scoring rule, not in the search procedure. The system is giving the wrong sentence a better score than the correct one, so the optimization step is not the main culprit. The next effort should go into improving how Score_B(S) is defined, estimated, or learned so that correct outputs receive higher scores than incorrect ones.

Key points:

• Score_B(S*) < Score_B(S_bad) points to a scoring-rule problem.
• The correct output is not being ranked above the incorrect one.
• The search/optimization procedure is not the primary issue.
• The next step is to improve the scoring model or its estimation.

Rubric: Full credit requires diagnosing the scoring component as the problem and recommending work on the scoring model or its approximation; partial credit is given if only one of those two ideas is stated clearly.