Learn Before
Expanding a text classification system
Case context: A team has built a customer support intent classifier with a modest neural network and 8,000 labeled chat transcripts. Its performance has stalled. They can either greatly enlarge the network or gather 60,000 additional labeled transcripts, but they cannot do both right away.
Question: If the best result will eventually come from having both a much larger network and much more data, what should the team conclude about its long-term plan, even if it must act in stages?
Sample answer: The team should conclude that reaching the strongest possible performance will likely require both changes: a larger network and a much larger dataset. Improving only one of them may help for a while, but each has a limit on its own. The long-term plan should therefore include a path to scale both model capacity and training data.
Key points:
- Improving only one factor has limits.
- The long-term target is scaling both dimensions.
- Best performance requires both a much larger network and much more data.
Rubric: Evaluates whether the learner understands that the highest performance usually depends on increasing both model size and data volume over time.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Increasing Model Capacity and Training Data as Dependable Improvements
Large Labeled Datasets Can Make Neural Networks a Strong Choice
What setup is most likely to achieve the strongest neural network performance?
Larger models can sometimes achieve better results
Two ingredients behind _____ performance
Matching model scale to performance outcomes
How to pursue better performance with a large model
Why model capacity must be matched with data scale
Expanding a text classification system
What two ingredients are needed to reach peak neural network performance?
What happens when a neural network is made larger?
Model size and data volume