Case context: A voice-to-text system assigns a score to each candidate transcript for a 12-second recording using Score_R(T) = P(T|R). For one recording, the system outputs “Please send the report tomorrow,” but the correct transcription is “Please send the support tomorrow.” The engineer checks the scores and finds that Score_R("Please send the support tomorrow") is lower than Score_R("Please send the report tomorrow").

Question: Should the engineer focus on the scoring function or on the search/maximization procedure? Explain why.

Sample answer: The scoring function is the likely problem. The correct transcript has a lower score than the transcript that was selected, so the score assignments are not ranking the true answer above the incorrect one. If the search procedure were perfect, it would still return the higher-scoring candidate, which in this case is wrong. So the fix should target the scoring function, such as improving the model or training data, rather than the search step.

Key points:

• Compare the score of the correct transcript with the score of the chosen transcript.
• If the correct transcript scores lower, the scoring function is the issue.
• If the correct transcript scores higher but was not chosen, the search procedure is the issue.
• This matches the logic of checking whether optimization or scoring is responsible.

Rubric: Full credit for identifying the scoring function as the source of the error when the correct transcript receives a lower score, and for explaining that this indicates a ranking problem rather than a search problem.