Learn Before
What to Do When an End-to-End System Is Still Weak
Question: Suppose each part of a document-processing system appears to work as well as a person, but the complete system still performs poorly. What action should be taken?
Sample answer: The overall system should be redesigned, because the problem is with the pipeline itself rather than any single component.
Key points:
- The pipeline is flawed.
- The system should be redesigned.
Rubric: Give full credit if the learner says the overall pipeline or system needs to be redesigned or reworked. Answers that mention only fixing one isolated component should not receive full credit.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When a Processing Stage Lacks the Right Input
If every component of a machine learning system matches human performance, but the full system is still much worse than human performance, what should you conclude?
Perfect Subsystems Always Produce a Perfect Pipeline
If every stage of a learning system looks strong on its own but the full system still underperforms, the overall design is usually _____ and should be rethought.
Match each pipeline diagnosis idea to its meaning.
Order the diagnostic steps for checking whether a multi-stage model is poorly designed even when each stage seems strong on its own.
In a warehouse-robot example, people who see only the robot's camera feeds choose better routes than the full machine-learning pipeline, even though each module has been tuned to human level. What is the best conclusion?
Error analysis on a weak machine learning pipeline can reveal that the overall system design should be changed.
When comparing a system module to human performance, the human should receive the _____ that the module receives.
Match each system outcome to the most reasonable diagnosis.
Put these steps in the order that shows why a model pipeline should be redesigned when every component is already performing at human level.
What a Strong Pipeline Can Still Get Wrong
Troubleshooting an Autonomous Delivery System
What to Do When an End-to-End System Is Still Weak