Learn Before
Explain why a compact neural network is defined by structure, not by accuracy.
Question: In a brief analytical response, distinguish how a compact neural network is identified from the result it may achieve on a labeled prediction task.
Sample answer: A network is described as compact because of its design: it uses few hidden layers, few hidden units, or a limited number of parameters. If that same model is trained on a labeled task, it may sometimes perform a little better, but that outcome is not what makes it compact. The definition comes from the architecture, not from the final score.
Key points:
- Compactness refers to the network architecture.
- The structural cues are layers, units, and parameter count.
- Better task performance may happen, but it is only a possible result.
- The size label does not depend on the metric value.
Rubric: A strong response clearly gives the structural definition, separates it from possible performance gains, and avoids implying that improved accuracy is required for the network to count as compact.
0
1
Tags
Python Programming Language
Data Science
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which description best fits a small neural network here?
A network is only considered small if it has few hidden units, few layers, and few parameters at the same time.
Small Neural Network Capacity
Match each network-size clue with what it tells you.
Order the steps for deciding whether a network is small.
Explain why a compact neural network is defined by structure, not by accuracy.
Decide Whether a Model Should Be Called Compact
How is a compact neural network typically described?
What best distinguishes a model’s size from its observed performance?
A Neural Network Can Be Called Small From Its Parameter Count Alone