Learn Before
Error Category Frequency Helps Indicate Which Categories to Focus On
After carrying out error analysis on 100 misclassified dev set examples, working on a project to address Dog mistakes can eliminate 8% of the errors at most. Working on Great Cat or Blurry image errors could help eliminate more errors, so one might pick one of those categories to focus on.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Related
Examples Can Belong to Multiple Error Categories
Discovering New Error Categories While Reviewing Examples
Most Helpful Error Categories Are Ones You Have Ideas to Improve
Error Analysis Is an Iterative Process
Error Category Frequency Helps Indicate Which Categories to Focus On
Pursuing Multiple Error Categories in Parallel
Error Analysis Does Not Yield a Rigid Priority Formula
Error Category Fraction as a Ceiling on Possible Error Reduction
Error Analysis as a Quantitative Basis for Project Investment Decisions
Engineer Reluctance to Perform Error Analysis Despite Its Low Time Cost
Mislabeled Examples in the Dev Set
Splitting a Large Dev Set into a Manually Examined Subset and a Hands-Off Subset
Build a Basic System Quickly and Iterate Using Error Analysis
Training Set Error Analysis for High Bias
Manually Reviewing 100 Speech Recognition Dev Set Examples
Debugging Inference Algorithms
Error Analysis by Parts
Error Analysis as Data Science for ML Mistakes
No Single Right Way to Perform Error Analysis
Human-Solvable Problems Enable More Powerful Error Analysis Tools
What does error analysis primarily examine to understand an ML system's mistakes?
There is exactly one correct method for conducting error analysis on an ML system.
The process of looking at misclassified examples to understand error causes is called _____.
Match each error analysis concept to its correct description from Machine Learning Yearning.
Order the steps of conducting a basic error analysis on a dev set as described in Machine Learning Yearning.
What is the primary goal of reviewing misclassified examples during error analysis, even in categories you cannot yet fix?
Machine Learning Yearning describes error analysis as an iterative process.
Error analysis can often help you figure out how _____ different improvement directions are.
Match each error analysis activity to the benefit it provides according to Machine Learning Yearning.
Order the reasoning steps for deciding which error categories to pursue after completing an initial error analysis.
Learn After
After error analysis on 100 misclassified dev set examples, Dog errors account for 8%. Which category should you likely prioritize?
Working on Dog classification mistakes can eliminate at most 8% of total errors, based on error analysis of 100 misclassified dev set examples.
Error analysis on 100 misclassified dev set examples shows that Dog mistakes can eliminate _____ of the errors at most.
Match each error category from Ng's example to the correct description of its impact on total errors.
Order the steps Ng recommends for using error category frequency to decide which error type to focus on.
In Ng's error analysis framework, what does an error category's percentage of misclassified examples represent?
According to Ng, you should always prioritize the error category that is easiest to fix, regardless of how often it appears in error analysis.
The percentage of misclassified dev set examples in a given error category represents the _____ percentage of total errors that could be eliminated by fixing it.
Match each term from Ng's error analysis framework to its correct definition.
Order the reasoning steps that explain why Ng concludes Dog errors should NOT be prioritized over Great Cat or Blurry image errors.