Learn Before
Debugging Inference Algorithms
When an inference system returns a wrong output, debugging should distinguish whether the approximate search algorithm failed or whether the scoring function assigned inaccurate scores. Knowing which cause is responsible determines whether to improve the search algorithm or the learning algorithm that estimates the score.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Related
Examples Can Belong to Multiple Error Categories
Discovering New Error Categories While Reviewing Examples
Most Helpful Error Categories Are Ones You Have Ideas to Improve
Error Analysis Is an Iterative Process
Error Category Frequency Helps Indicate Which Categories to Focus On
Pursuing Multiple Error Categories in Parallel
Error Analysis Does Not Yield a Rigid Priority Formula
Error Category Fraction as a Ceiling on Possible Error Reduction
Error Analysis as a Quantitative Basis for Project Investment Decisions
Engineer Reluctance to Perform Error Analysis Despite Its Low Time Cost
Mislabeled Examples in the Dev Set
Splitting a Large Dev Set into a Manually Examined Subset and a Hands-Off Subset
Build a Basic System Quickly and Iterate Using Error Analysis
Training Set Error Analysis for High Bias
Manually Reviewing 100 Speech Recognition Dev Set Examples
Debugging Inference Algorithms
Error Analysis by Parts
Error Analysis as Data Science for ML Mistakes
No Single Right Way to Perform Error Analysis
Human-Solvable Problems Enable More Powerful Error Analysis Tools
What does error analysis primarily examine to understand an ML system's mistakes?
There is exactly one correct method for conducting error analysis on an ML system.
The process of looking at misclassified examples to understand error causes is called _____.
Match each error analysis concept to its correct description from Machine Learning Yearning.
Order the steps of conducting a basic error analysis on a dev set as described in Machine Learning Yearning.
What is the primary goal of reviewing misclassified examples during error analysis, even in categories you cannot yet fix?
Machine Learning Yearning describes error analysis as an iterative process.
Error analysis can often help you figure out how _____ different improvement directions are.
Match each error analysis activity to the benefit it provides according to Machine Learning Yearning.
Order the reasoning steps for deciding which error categories to pursue after completing an initial error analysis.
Learn After
Search Algorithm Problem in Inference
Scoring Function Problem in Inference
Optimization Verification Test
When an inference system returns a wrong output, which two root causes should a developer distinguish between to debug effectively?
Identifying whether the search algorithm or scoring function caused an inference failure determines which component you should prioritize improving.
If the approximate search algorithm fails to find the value of S that maximizes Score_A(S), the correct fix is to work on improving the _____ algorithm.
Match each inference failure type to its precise description as defined in Machine Learning Yearning.
Arrange the steps of the inference debugging process described in MLY in the correct logical order.
According to MLY, what is a 'scoring function problem' in the context of debugging inference systems?
Randomly choosing whether to improve the search algorithm or scoring function is an acceptable debugging strategy when an inference system produces wrong outputs.
When the scoring function is identified as the inference failure cause, you should work on the _____ algorithm that estimates Score_A(S).
Match each identified inference failure cause to the correct recommended action from Machine Learning Yearning.
Arrange the reasoning steps used to determine whether an inference failure is caused by an inaccurate scoring function.
Contrast the target actions required when debugging an inference system's search algorithm versus its scoring function.
Diagnosing incorrect transcriptions in a speech recognition inference system
Consequence of randomly choosing between improving search or scoring during inference debugging