Locating the faulty stage in an inspection pipeline.
Case context: A warehouse inspection system has three stages: Package Scanning (A), Damage Classification (B), and Dispatch Routing (C). On one dev-set case, the system assigns the wrong route. You substitute a flawless output for Package Scanning (A), but the route is still wrong. You then substitute a flawless output for Damage Classification (B), and the route becomes correct.
Question: Using the general error attribution procedure, which stage should the engineer blame for the incorrect routing on this dev-set case, and why?
Sample answer: The engineer should blame Damage Classification (B). The attribution procedure says to test stages in order: if a perfect output for A does not correct the outcome, continue to B. In this case, fixing A alone did not solve the routing error, but fixing B did. That means the system would have produced the right result if B had been better on this example, so B is the source of the mistake.
Key points:
- Stage B (Damage Classification) caused the error.
- A perfect output for A was not enough to correct the system.
- A perfect output for B made the overall output correct.
Rubric: The response must name stage B (Damage Classification) as the error source and explain the choice using the logic of the attribution procedure.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Error Attribution in a Multi-Step Robot Pipeline
Using DAG Structure to Trace Errors in a Workflow
Why would you substitute a component’s output with an idealized output during a diagnostic error check?
If giving module A a perfect intermediate result makes the whole pipeline succeed, the error should be blamed on module B.
In a workflow P → Q → R, if substituting P's output with the correct output makes the full workflow succeed, the error is in _____.
Match each pipeline scenario to the correct error conclusion.
Order the attribution steps for diagnosing errors in a three-stage pipeline A → B → C.
In a three-stage pipeline X → Y → Z, when does the substitution test point to Z as the source of the error?
Diagnosing a pipeline mistake means retraining each module from the beginning every time.
Apply the attribution test to one dev-set _____ at a time.
Match each stage in a three-step pipeline to the diagnostic move used to test whether it is causing a validation error.
Order the reasoning steps for deciding which subsystem to improve after analyzing many dev-set failures in a multi-stage process.
How to isolate the source of an error in a three-stage workflow
Locating the faulty stage in an inspection pipeline.
Default fault assignment in a three-stage process.