Diagnose the priority for a team training models on only 20 examples.
Case context: A team has about 20 training examples. It is debating whether to use logistic regression or a neural network, but it has spent little time considering how the features are hand-engineered.
Question: Based only on the source evidence, what should the team diagnose as the potentially more important issue, and what assumption should it avoid?
Sample answer: The team should diagnose feature hand-engineering as the potentially more important issue because, with about 20 examples, it can have a bigger effect than choosing logistic regression or a neural network. The team should avoid assuming that either traditional algorithms or neural networks will automatically perform better in the small data regime.
Key points:
- The dataset is in a small data regime.
- Feature hand-engineering may have the bigger effect.
- The logistic-regression-versus-neural-network choice may matter less.
- Neither model family is guaranteed to perform better.
Rubric: Full credit requires identifying feature hand-engineering as the priority, connecting that priority to the approximately 20-example setting, and rejecting a guaranteed performance winner between traditional algorithms and neural networks.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
With about 20 training examples, which decision is likely to have the larger effect?
Traditional algorithms always outperform neural networks on small datasets.
With about 20 examples, _____ can matter more than algorithm choice.
Match each small-data claim with its meaning.
Order the reasoning for choosing what to prioritize with very little training data.
Explain why algorithm choice may be secondary in a very small data regime.
Diagnose the priority for a team training models on only 20 examples.
Why can a traditional algorithm's small-data advantage be uncertain?
Which conclusion best reflects the source's comparison across dataset sizes?
With 20 examples, feature design may deserve more attention than switching model families.