Decide how to supply knowledge when an end-to-end system has very little training data.
Case context: A team has a very small training set. Its end-to-end system lacks hand-engineered knowledge, while an alternative pipeline can incorporate components based on the team's insight.
Question: What should the team recognize about the two approaches, and which source of knowledge should it emphasize?
Sample answer: The team should recognize that the end-to-end system might do worse than the hand-engineered pipeline because the training set is small and the system lacks hand-engineered knowledge. It should emphasize human insight encoded through hand-engineered components, since most of the algorithm's knowledge may need to come from that source in this setting.
Key points:
- The training set is very small.
- The end-to-end system lacks hand-engineered knowledge.
- It might underperform the hand-engineered pipeline.
- Human insight should be encoded through hand-engineered components.
Rubric: The response should diagnose the risk caused by scarce training data, compare the end-to-end system with the hand-engineered pipeline without claiming guaranteed outcomes, and recommend emphasizing human insight through hand-engineered components.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Why might an end-to-end system underperform a hand-engineered pipeline when training data is scarce?
In a very small-data setting, most algorithmic knowledge may need to come from human insight.
With very little training data, most knowledge may need to come from human _____.
Match each small-data concept with its source-grounded meaning.
Order the reasoning for choosing hand engineering in a small-data setting.
Explain why small training sets can increase the value of hand-engineered components.
Decide how to supply knowledge when an end-to-end system has very little training data.
What supplies most of an algorithm's knowledge when its training set is very small?
Which design response best follows from having a very small training set?
A small training set guarantees that every hand-engineered pipeline will beat every end-to-end system.