Learn Before
Using Human Judgment in Error Analysis
Question: Briefly explain the main purpose of using human judgment during error analysis when a model is performing worse than people.
Sample answer: The purpose is to identify which cues or information a person uses to reach the correct answer, and then use that insight to improve the model.
Key points:
- Identify the cues humans rely on
- Improve the algorithm using that insight
Rubric: The answer must state that the goal is to learn what information people use to get the correct answer and then apply that understanding to improve the algorithm.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When is it especially useful to apply human-style error analysis?
A useful aim of error analysis is to infer which clues a person relies on to reach the correct label.
A transcript turned “blueberry muffins” into “_____ muffins.”
Match each part of expert-guided error analysis to its role.
Arrange the steps for human-guided error analysis on a weak model.
How can domain expertise be used when analyzing errors in chest X-ray classification?
Human-guided error analysis is most informative when the model still performs worse than people.
In error analysis, human _____ can help reveal which clues people use to reach the right label.
Connect each case to the way human judgment helps diagnose model mistakes.
Order the steps for using expert intuition to improve a crop-disease image classifier.
Use human judgment to interpret model mistakes
Using clinician insight to improve a chest scan classifier
Using Human Judgment in Error Analysis