Learn Before
Case Study

Decide Whether a Model Should Be Called Compact

Case context: A team builds a neural network for the same classification task and describes it as "compact" because it improved the validation score a little.

Question: Explain what is wrong with that conclusion and state what evidence the team should inspect before using the label.

Sample answer: The conclusion is not justified because a small improvement in score does not tell you whether the network is compact. The team should look at the model's architecture and size: the number of layers, hidden units, and learned parameters. Those properties describe the model's scale; the score improvement is only a possible outcome, not the definition.

Key points:

  • Better validation performance does not define compactness.
  • The label should come from the model's structure, not its accuracy.
  • Inspect layers, hidden units, and parameter count.
  • Use architecture size to decide whether the label fits.

Rubric: The response should reject performance as the deciding factor and instead use structural evidence such as layers, hidden units, or parameters.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Python Programming Language

Data Science

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI