Learn Before
When a Processing Stage Lacks the Right Input
A workflow may stall or underperform even when each stage is operating about as well as it can. The real problem can be that an earlier stage does not supply enough information. A useful redesign question is what additional facts a skilled person would want before making the same decision.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When a Processing Stage Lacks the Right Input
If every component of a machine learning system matches human performance, but the full system is still much worse than human performance, what should you conclude?
Perfect Subsystems Always Produce a Perfect Pipeline
If every stage of a learning system looks strong on its own but the full system still underperforms, the overall design is usually _____ and should be rethought.
Match each pipeline diagnosis idea to its meaning.
Order the diagnostic steps for checking whether a multi-stage model is poorly designed even when each stage seems strong on its own.
In a warehouse-robot example, people who see only the robot's camera feeds choose better routes than the full machine-learning pipeline, even though each module has been tuned to human level. What is the best conclusion?
Error analysis on a weak machine learning pipeline can reveal that the overall system design should be changed.
When comparing a system module to human performance, the human should receive the _____ that the module receives.
Match each system outcome to the most reasonable diagnosis.
Put these steps in the order that shows why a model pipeline should be redesigned when every component is already performing at human level.
What a Strong Pipeline Can Still Get Wrong
Troubleshooting an Autonomous Delivery System
What to Do When an End-to-End System Is Still Weak
Learn After
Adding an Aisle-Marker Detector to a Warehouse Navigation Pipeline
What Question Best Reveals Missing Input Information?
Downstream Limits from Upstream Data
Using a _____ to Identify Missing Inputs
Key Ideas for Diagnosing Missing Inputs in a Processing Pipeline
Diagnosing a Pipeline Stage with Missing Inputs
Why a Pipeline Step Can Still Fail with Perfect Execution
Autonomous Delivery Robot Route Planning with Incomplete Inputs
Using a Human Reference for Missing Pipeline Information
What does missing downstream information usually imply?
A Bigger Model Can Recover Missing Input Information