If a model is trained and tested only on studio photos, that evaluation can still miss poor performance on blurry customer-uploaded phone pictures.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Why did the deployed flower classifier work well on its original test set but poorly after launch?
The evaluation set matched the camera conditions seen during deployment.
Field Photos from Visitor Tablets
Match each part of the bird-photo classifier example to its role in the distribution shift.
Order the steps that exposed a data-distribution mismatch in an email spam filter.
Why Did Good Results on Scanned Documents Not Guarantee Success on Phone Photos?
Diagnose a document classifier that works on office scans but fails on phone photos.
How User Photos Differed from Catalog Images
What did the model's strong result on the website-based test set actually show?
If a model is trained and tested only on studio photos, that evaluation can still miss poor performance on blurry customer-uploaded phone pictures.