Include Some Target-Distribution Examples in Training Alongside Auxiliary Data
Some data drawn from the same distribution as the dev/test set can be included in the training set. In the in-car audio example, if the training and training dev sets include in-car audio, good performance on in-car training data but not on in-car training dev data further validates the hypothesis that getting more in-car data would help.
0
1
References
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Machine Learning Yearning (Deeplearning.ai)
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Avoid Randomly Shuffling Mixed-Source Data into Dev/Test Sets
Include Some Target-Distribution Examples in Training Alongside Auxiliary Data
Down-Weighting Auxiliary Data from a Different Distribution
Training Dev Set
Error Table Across Two Data Distributions and Three Error Types
Data Mismatch Between Training and Dev Set Distributions
Limited Practical Scope of Domain Adaptation for Different Data Distributions
Domain Adaptation for Different Data Distributions
Website Images and Mobile Phone Pictures as a Distribution Mismatch Example
Random 70/30 Train/Test Split Can Fail Under Distribution Shift
Which data should define the dev and test sets for the cat-picture app?
Dev and test sets should represent the future data distribution of interest.
Complete the principle: Dev and test sets should reflect _____ data.
Match each cat-app data group with its appropriate role or property.
Order the decisions for building datasets when auxiliary and target data differ.
Explain why different training and evaluation distributions can be appropriate.
Diagnose the evaluation-set mistake in a mobile cat-classification app.
Why did success on website images fail to ensure success on mobile uploads?
Which dataset design best uses both target and auxiliary cat images?
Using extra internet images for training requires internet images in dev and test sets.
Learn After
Checking a Mismatch Hypothesis on Training Dev Subsets
In a cat detector system with 10,000 user-uploaded images and 200,000 internet images, how should you split the target-distribution data?
True or False: We should use target-distribution training data alongside auxiliary data to help the network learn on it.
Adding target-distribution data to training means it contains data from the _____ distribution.
Match the cat detector data components with their distribution properties.
Order the decision process to allocate voice navigation data.
What is a benefit of having in-car audio in both training and training dev sets?
True or False: A training set from a different distribution than the dev/test set should still be used for learning.
Good performance on training but not on training dev validates the _____ hypothesis.
Match the performance outcomes on in-car audio with their implications.
Order the process of setting up and using a cat detector with mixed data.
Explain the rationale for including target-distribution examples in the training set.
Diagnosing Performance with Target-Distribution Data
Validating Data Needs via Training Dev Sets