Learn Before
Where does most of the model's knowledge come from when data is scarce?
Question: Answer in one to three sentences and explain how that knowledge is added to the model.
Sample answer: When the training set is very small, much of the model’s knowledge often comes from human expertise. That knowledge enters through manually designed features, rules, or other hand-built parts of the system.
Key points:
- Human expertise is the main source of knowledge in this setting.
- Manually designed components are how that expertise is incorporated.
Rubric: The answer must identify human expertise and connect it explicitly to manually designed components.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why can a fully end-to-end model trail a hand-designed pipeline when labeled examples are limited?
When labeled data is scarce, hand-designed features and rules may provide a large share of the system’s useful knowledge.
When labeled examples are scarce, much of the solution may need to come from human _____.
Match each small-data concept with its meaning.
Reasoning About Handcrafted Features With Very Little Data
Why can limited training data favor hand-designed system parts?
Choose where to place prior knowledge in a data-poor prediction task.
Where does most of the model's knowledge come from when data is scarce?
What is the most appropriate design choice when only a very small labeled dataset is available?
A very small training set does not automatically mean every hand-built pipeline will outperform every end-to-end model.