Theory and practice in distribution-shift research
Question: What is the present relationship between academic theory about training and evaluating models on different data distributions and what practitioners can do in real projects?
Sample answer: There is still a substantial gap between the formal theory and everyday practice, so the field has not yet produced a fully settled, routine method for real projects.
Key points:
- There is a substantial gap between theory and practice.
- The area is not yet a fully routine, standardized practice.
Rubric: Full credit given for mentioning the "substantial gap" between theory and practice.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
When are domain adaptation methods most useful?
Distribution Mismatch Can Mislead Development Tuning
Training on one data distribution and succeeding on another is called _____.
Ideas About Working Across Changing Data
Testing a Model on a Different Data Source
Why Hidden Factors Complicate Cross-Domain Learning
Evaluating Domain Adaptation for a Distribution Shift
Theory and practice in distribution-shift research
What can have a major impact when a model is applied to a very different dataset?
Domain Adaptation Is Commonly Used