Learn Before
Evaluating Consistent Auxiliary Data for a Damage Detector
Case context: A team is building a model that decides whether rental bikes in customer-submitted photos need repair. Their labeled target set comes from a mobile repair app, and they also have many labeled bike photos from a public website. In both sources, the label depends only on the image itself, not on where it was captured or uploaded.
Question: Should the website photos be added to training under the idea of a consistent auxiliary data source? State the condition that makes the sources compatible and describe the expected downside and upside.
Sample answer: Yes. The website photos are compatible because the same mapping from image x to label y applies no matter whether the photo came from the app or the website; the source identity is not needed to predict the label. The main downside is extra compute or data-processing effort, while the upside can be a large gain from having more training examples.
Key points:
- The auxiliary photos are consistent if one predictor maps x to y without needing source identity.
- The origin of the photo does not have to be known to assign the label.
- The main cost is computational, and the likely benefit is more data.
Rubric: Grading Rubric:
- Explains that the website photos should be included because they are a consistent auxiliary source.
- Explains the mapping condition: a function from x to y works without source information.
- Notes the main downside is added compute/data handling, with a potential benefit from more examples.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What makes an auxiliary data source consistent with a target task?
A document classifier must know whether a news article was written on a laptop or a phone in order to predict its topic correctly.
A helper dataset is compatible with the target task when the same _____ can assign labels in both places.
Match each term to its role when deciding whether a side dataset is a consistent auxiliary source.
Order the steps for checking whether a supplemental data source matches the main prediction task.
What is the main practical drawback of adding a consistent auxiliary data source during training?
A training source that follows the same labeling rule as the main task is usually low risk to include and can sometimes improve performance.
A Wildlife Classifier Does Not Need Image Provenance
Match each idea about auxiliary data to its meaning.
Order the steps for deciding whether to add a second data source to training.
Consistency Between Two Labeled Data Sources
Evaluating Consistent Auxiliary Data for a Damage Detector
Why the data source does not change a consistent label mapping