Learn Before
Human Benchmark for Pipeline Inputs
Question: If a pipeline component is failing because its inputs lack sufficient information, what specific benchmark or comparison should you use to determine what new information to add to the pipeline?
Sample answer: You should use a skilled human as a benchmark by asking what additional information a skilled human would need to successfully complete the same task.
Key points:
- Use a skilled human as a reference point.
- Ask what information the human requires for the task.
Rubric: The answer must explicitly mention asking what a skilled human would need to perform the task.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Adding a Lane-Marking Detector to a Self-Driving Pipeline
Best Question for Pipeline Redesign
Component Performance vs. Input Quality
Using a _____ as a Baseline for Missing Info
Concepts in Pipeline Information Deficiencies
Resolving Missing Information in Pipelines
Diagnosing Pipeline Component Failures
Self-Driving Path Planner Case Study
Human Benchmark for Pipeline Inputs
Implications of Missing Input Information
Solving Missing Information Issues