Learn Before
Diagnose pipeline failure in an autonomous vehicle system.
Case context: You are developing a self-driving car using a pipeline with three components: a car detector, a pedestrian detector, and a path planner. Evaluation shows that the car detector and pedestrian detector perform at near human-level. The path planner also performs near human-level when given ideal inputs. However, when the entire pipeline is tested on camera images, the vehicle's driving is far below human-level, often drifting out of lanes because it doesn't know where the lanes are.
Question: Based on the provided autonomous driving pipeline context, diagnose the primary system failure, explain why the overall system is underperforming despite strong individual components, and decide on a targeted pipeline modification to resolve the issue.
Sample answer: The primary system failure is an information gap; the pipeline is missing crucial information needed for proper path planning (specifically, lane locations). Even though the car and pedestrian detectors and path planner are near human-level given their inputs, the path planner does not receive lane-marking information. To resolve this, a lane-marking detector should be added to the pipeline to process camera images and feed lane coordinates directly to the path planner. This addresses the missing information without forcing the path planner to process raw camera images.
Key points:
- Diagnose the failure as an information gap (missing lane/road information).
- Explain that the path planner performs well given its inputs, but the inputs are insufficient for safe driving.
- Decides on adding a lane-marking detector to the pipeline to detect lane markings.
- Avoids making the path planner directly consume raw images by using the detector's output.
Rubric: The response must correctly diagnose the issue as an information gap (specifically missing lane/road structure information), explain that near-human component performance on limited inputs doesn't prevent failure if essential inputs are missing, and decide on adding a lane-marking detector to feed information to the path planner rather than sending raw images directly to the path planner.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Related
Autonomous Driving Pipeline Encodes Simpler Subtasks
Why can an autonomous-driving pipeline perform far below human level even when each of its components individually operates near human level?
True or False: In an autonomous-driving pipeline, every component—including path planning—must use a machine-learned model.
Adding a _____ detector to an autonomous-driving pipeline can supply missing road-context information to the path planner without requiring the planner to consume raw camera images.
What are the three components in the simple autonomous driving pipeline described in Machine Learning Yearning?
True or False: Every component in a machine learning pipeline must be a learned model.
When an autonomous driving pipeline underperforms overall despite each component being near human-level, adding a _____ detector can supply the missing information.
Match each autonomous driving pipeline component to its role in the pipeline.
Order the reasoning steps for diagnosing why an autonomous driving pipeline underperforms humans despite each sub-component being individually strong.
If each sub-component of an autonomous driving pipeline is near human-level given its inputs but the full system underperforms humans, what is the most likely cause?
True or False: According to Machine Learning Yearning, obtaining training data for car and pedestrian detectors is relatively easy due to existing datasets and crowdsourcing.
Machine Learning Yearning states that _____ (such as Amazon Mechanical Turk) can be used to obtain larger labeled datasets for training car and pedestrian detectors.
Match each pipeline diagnosis concept to its correct description in the autonomous driving example.
Order the steps for fixing an information gap in the autonomous driving pipeline by adding a lane-marking detector.
Explain how to address an information gap in an autonomous driving pipeline.
Diagnose pipeline failure in an autonomous vehicle system.
Explain the benefit of using a lane-marking detector in a pipeline.