Learn Before
Search Algorithm Problem in Inference
A search algorithm problem occurs when the scoring function assigns a higher score to the correct output, but the approximate search algorithm still selects the wrong output. This indicates that improving the search algorithm, such as increasing beam width in beam search, is the right focus.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Search Algorithm Problem in Inference
Scoring Function Problem in Inference
Optimization Verification Test
When an inference system returns a wrong output, which two root causes should a developer distinguish between to debug effectively?
Identifying whether the search algorithm or scoring function caused an inference failure determines which component you should prioritize improving.
If the approximate search algorithm fails to find the value of S that maximizes Score_A(S), the correct fix is to work on improving the _____ algorithm.
Match each inference failure type to its precise description as defined in Machine Learning Yearning.
Arrange the steps of the inference debugging process described in MLY in the correct logical order.
According to MLY, what is a 'scoring function problem' in the context of debugging inference systems?
Randomly choosing whether to improve the search algorithm or scoring function is an acceptable debugging strategy when an inference system produces wrong outputs.
When the scoring function is identified as the inference failure cause, you should work on the _____ algorithm that estimates Score_A(S).
Match each identified inference failure cause to the correct recommended action from Machine Learning Yearning.
Arrange the reasoning steps used to determine whether an inference failure is caused by an inaccurate scoring function.
Contrast the target actions required when debugging an inference system's search algorithm versus its scoring function.
Diagnosing incorrect transcriptions in a speech recognition inference system
Consequence of randomly choosing between improving search or scoring during inference debugging
Learn After
When ScoreA(S*) > ScoreA(Sout) but the algorithm outputs Sout, what is the diagnosis?
True or False: Increasing beam width is a reasonable fix for a search algorithm problem.
A search algorithm problem occurs when the scoring function ranks the correct output higher, but the _____ still selects the wrong output.
Match each score comparison outcome to its diagnostic conclusion. for Search Algorithm Problem in Inference
Order the steps of diagnosing a search algorithm problem using the Optimization Verification test.
Explain why a higher scoring function value for S* does not guarantee the system will output S*.
Diagnose the beam search failure in a translation system.
Why does correctly ranking S* above Sout still result in an error output?
Which component is targeted for improvement when a search algorithm problem is diagnosed?
True or False: A search algorithm problem means the scoring function assigned Sout a higher score than S*.