Learn Before
Consistency Between Two Labeled Data Sources
Question: In a supervised learning setting, imagine you have a main labeled dataset and an additional labeled dataset collected from a different process. Explain when the two sources are considered consistent. In your explanation, describe the meaning of a single mapping f(x) from input x to label y, and name the main practical drawback of training with the extra source.
Sample answer: The two sources are consistent if one prediction rule can be used for both of them: the same function f(x) should map an input x to the correct label y no matter which source produced the example. The main downside of using the extra source is higher training cost, since the model must process more examples and therefore use more computation.
Key points:
- Consistency means one input-to-label rule works across both sources.
- f(x) should predict y without needing to know where the example came from.
- The main practical drawback is added computation from training on more data.
Rubric: Grading Rubric:
- Describes consistency as a shared mapping from inputs to labels across both sources.
- States that the function f(x) does not depend on the source identity.
- Identifies increased computational cost as the primary practical disadvantage.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What makes an auxiliary data source consistent with a target task?
A document classifier must know whether a news article was written on a laptop or a phone in order to predict its topic correctly.
A helper dataset is compatible with the target task when the same _____ can assign labels in both places.
Match each term to its role when deciding whether a side dataset is a consistent auxiliary source.
Order the steps for checking whether a supplemental data source matches the main prediction task.
What is the main practical drawback of adding a consistent auxiliary data source during training?
A training source that follows the same labeling rule as the main task is usually low risk to include and can sometimes improve performance.
A Wildlife Classifier Does Not Need Image Provenance
Match each idea about auxiliary data to its meaning.
Order the steps for deciding whether to add a second data source to training.
Consistency Between Two Labeled Data Sources
Evaluating Consistent Auxiliary Data for a Damage Detector
Why the data source does not change a consistent label mapping