Learn Before
Prioritize the Module With the Largest Share of Errors
If 100 dev-set mistakes are traced to 88 failures in the lane-detection module and 12 failures in the speed-sign classifier, the team should direct its next improvement effort toward the lane-detection module first.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Two-Stage Pipeline Error Analysis
Prioritize the Module With the Largest Share of Errors
Locating Mistakes in a Multi-Stage System
Unclear Blame in a Multi-Stage Pipeline
Component-by-Component Error Diagnosis in a Three-Stage Workflow
Using Human Performance as a Debugging Benchmark
What is the main purpose of error analysis by parts in a multi-step system?
Error analysis by parts must always be done with a formal procedure and cannot be done informally.
Error analysis by parts helps identify which component deserves the greatest _____ for improvement.
Match each error-analysis concept to its role in a modular ML pipeline.
Order the steps of a simple error analysis routine for a ticket-routing pipeline.
Which three modules are used in the warehouse robot example for parts-based error analysis?
Component-level error analysis is mainly used to identify which stage of a system should be improved first.
Finding Which Component Caused the Error
Match each warehouse-robot pipeline stage to the output it produces.
Arrange the steps for using part-by-part error analysis to decide what to improve first.
Explain how error analysis by parts helps prioritize improvements in a machine learning system.
Deciding which module to improve first in a driving stack.
What error analysis by parts helps you decide
Learn After
Example Attribution Can Support a Second Pass of Debugging
Which component should receive the most attention if 72 of 80 dev-set mistakes come from the signal preprocessor?
A single source of most validation errors should receive priority.
Identify the component with the most assigned errors
Interpreting Component Error Counts
Order the steps for using component error counts to prioritize pipeline fixes.
A speech-recognition pipeline shows 9 times as many dev-set mistakes in the wake-word detector as in the speaker-id module. What should the team do next?
If one subsystem is responsible for 10 out of 100 validation mistakes, it should be the first area the team improves.
Reviewing 100 incorrect validation predictions and assigning each one to a pipeline _____ shows which step should be improved first.
Match each pipeline error-analysis term to its correct description.
Order the steps used to decide which pipeline component deserves improvement first.
Use component error counts to set improvement priorities.
Using component error counts to decide where to improve a document-processing pipeline.
Choose the component to improve when most dev-set mistakes come from one stage.