Why model flexibility changes the risk of combining training data sources
Question: In a brief analytical response, explain why combining different training data sources, such as clinic photos and mobile-phone photos, can be risky for some learning systems but not for others. Compare older, less flexible methods with modern, highly flexible methods.
Sample answer: Older approaches, such as manually crafted visual features followed by a simple classifier, had limited ability to adapt to differences between sources, so mixing clinic photos and mobile-phone photos could reduce accuracy. Modern methods, such as large neural networks, are much more flexible and can absorb a wider range of variation, so combining those sources is usually far less risky.
Key points:
- Older methods with fixed feature design plus a simple classifier were more likely to suffer from mixed-source data
- Modern large neural networks are much less sensitive to this issue
- The main reason is the model's flexibility or capacity
- The example involves combining two different image sources
Rubric: Full credit requires naming both categories of algorithms (older hand-crafted-feature plus simple-classifier methods and modern large neural networks), describing the different risk levels for each, and explaining that the difference comes from model flexibility.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Combining Two Image Sources with a High-Capacity Model
Why is it less risky today to combine customer-supplied photos with web-scraped photos in one training set?
True or False: Combining data from different sources could sometimes make older machine-learning systems perform worse.
A classic early vision pipeline used hand-crafted image features followed by a simple _____ classifier.
Match each model type or factor to its role in the risk of combining training data sources.
Order the reasoning steps for deciding whether to combine training datasets.
Why model flexibility changes the risk of combining training data sources
Should this team combine two review datasets with a simple model?
What makes combining training data from multiple sources risky?
Which model family is most exposed to trouble when two data sources disagree?
True or False: Using a very large neural network completely removes the risk of problems when combining multiple training data sources.