Learn Before
Case Study

Diagnose a speech recognition error using the scoring function framework.

Case context: A speech recognition system computes Score_A(S) = P(S|A) for an audio clip A. For a particular clip, the system outputs the sentence 'I love your city' but the correct transcription is 'I love acity.' The engineer checks Score_A('I love acity') and finds it is lower than Score_A('I love your city'), even though 'I love acity' is the correct answer.

Question: Based on this scoring comparison, should the engineer conclude the problem is in the scoring function or in the search/maximization algorithm? Explain your reasoning.

Sample answer: Since the correct sentence 'I love acity' received a lower score than the incorrect output 'I love your city', the scoring function itself is failing to rank the correct answer highest. This means the problem lies in the scoring function (it needs to be improved, e.g., via better training data or model), not in the search algorithm, because even a perfect search would have found and returned the higher-scoring but wrong sentence.

Key points:

  • Compare Score_A of the correct sentence to Score_A of the algorithm's output
  • If the correct sentence scores lower, the scoring function is at fault
  • If the correct sentence scores higher or equal but wasn't chosen, the search algorithm is at fault
  • This reasoning reflects the Optimization Verification test

Rubric: Full credit for correctly identifying that a lower score for the correct sentence indicates a scoring function problem, and for explaining that this conclusion follows from the Optimization Verification test logic described in the source.

0

1

Updated 2026-07-11

Contributors are:

Who are from:

Tags

Data Science

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Machine Learning Yearning @ DeepLearning.AI