When should post-launch user data be used to refresh dev and test sets?
Question: Answer in one to three sentences: After a product has shipped, when is it appropriate to use real user data to revise the dev and test sets, and which sets may be refreshed?
Sample answer: Once the app is live and you have collected real user behavior, you may rebuild or update both the development set and the test set.
Key points:
- After launch
- Using real user data
- Updating both development and test sets
Rubric: The answer must mention that the app is already launched, that the data comes from actual users, and that both the dev set and the test set can be updated.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Refreshing evaluation sets after deployment
True or False: Evaluation sets must remain frozen forever after deployment.
After deployment, evaluation sets may be refreshed with actual _____ data.
Match the post-release data update components
Order the steps for refreshing evaluation data after launch
How can post-launch user data change evaluation sets in an app project?
Case Study: Updating evaluation data after a product launch
When should post-launch user data be used to refresh dev and test sets?
A logistics app is launched and begins collecting live customer records. Which action is supported?
Real user logs can be used to refresh both evaluation sets after launch.