Domain Adaptation Research Versus Application-Focused Data Splits
Question: Explain how the goal of domain adaptation research differs from the strategy recommended for improving one specific machine learning system.
Sample answer: Domain adaptation research focuses on building methods that train on one data distribution and still perform well on another, which makes it a broad and intellectually interesting problem. For a single application, it is usually more practical to create the development and test sets from the same distribution as the intended deployment data, because that gives clearer feedback and lets the team iterate faster.
Key points:
- Domain adaptation studies transfer across different data distributions.
- It is primarily a research problem.
- For a specific application, the development and test sets should usually match each other and the target use case.
- Matching the data distributions for evaluation is often more efficient than trying to solve transfer early on.
Rubric: The response should contrast the research goal of transferring across distributions with the practical advantage of using matching development and test sets for a specific application.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Use Matching Dev and Test Distributions for Application Work
For an application project, what data-splitting rule is most helpful?
Domain adaptation methods are the default solution for most machine learning projects.
Domain adaptation means training on one _____ and expecting useful performance on another.
Match each machine-learning concept to its description.
Order the steps for choosing dev/test data when the project data differs from deployment data.
When are domain adaptation methods usually a good fit?
Selecting development and test sets from the same data distribution can improve team efficiency.
Dev and test sets should come from the _____ distribution.
Match each project goal to the strategy associated with it.
Order the main ideas behind matching dev and test data to the deployment setting.
Domain Adaptation Research Versus Application-Focused Data Splits
Choose evaluation strategy for a crop disease app.
Why choose dev and test sets from the same distribution instead of building a special adaptation method?