Learn Before
Theory and practice in distribution-shift research
Question: What is the present relationship between academic theory about training and evaluating models on different data distributions and what practitioners can do in real projects?
Sample answer: There is still a substantial gap between the formal theory and everyday practice, so the field has not yet produced a fully settled, routine method for real projects.
Key points:
- There is a substantial gap between theory and practice.
- The area is not yet a fully routine, standardized practice.
Rubric: Full credit given for mentioning the "substantial gap" between theory and practice.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When are domain adaptation methods most useful?
Distribution Mismatch Can Mislead Development Tuning
Training on one data distribution and succeeding on another is called _____.
Ideas About Working Across Changing Data
Testing a Model on a Different Data Source
Why Hidden Factors Complicate Cross-Domain Learning
Evaluating Domain Adaptation for a Distribution Shift
What can have a major impact when a model is applied to a very different dataset?
Domain Adaptation Is Commonly Used
Related
When are domain adaptation methods most useful?
Distribution Mismatch Can Mislead Development Tuning
Training on one data distribution and succeeding on another is called _____.
Ideas About Working Across Changing Data
Testing a Model on a Different Data Source
Why Hidden Factors Complicate Cross-Domain Learning
Evaluating Domain Adaptation for a Distribution Shift
What can have a major impact when a model is applied to a very different dataset?
Domain Adaptation Is Commonly Used