Learn Before
Decide Whether a Model Should Be Called Compact
Case context: A team builds a neural network for the same classification task and describes it as "compact" because it improved the validation score a little.
Question: Explain what is wrong with that conclusion and state what evidence the team should inspect before using the label.
Sample answer: The conclusion is not justified because a small improvement in score does not tell you whether the network is compact. The team should look at the model's architecture and size: the number of layers, hidden units, and learned parameters. Those properties describe the model's scale; the score improvement is only a possible outcome, not the definition.
Key points:
- Better validation performance does not define compactness.
- The label should come from the model's structure, not its accuracy.
- Inspect layers, hidden units, and parameter count.
- Use architecture size to decide whether the label fits.
Rubric: The response should reject performance as the deciding factor and instead use structural evidence such as layers, hidden units, or parameters.
0
1
Tags
Python Programming Language
Data Science
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which description best fits a small neural network here?
A network is only considered small if it has few hidden units, few layers, and few parameters at the same time.
Small Neural Network Capacity
Match each network-size clue with what it tells you.
Order the steps for deciding whether a network is small.
Explain why a compact neural network is defined by structure, not by accuracy.
Decide Whether a Model Should Be Called Compact
How is a compact neural network typically described?
What best distinguishes a model’s size from its observed performance?
A Neural Network Can Be Called Small From Its Parameter Count Alone