Learn Before
Essay

Explain why a compact neural network is defined by structure, not by accuracy.

Question: In a brief analytical response, distinguish how a compact neural network is identified from the result it may achieve on a labeled prediction task.

Sample answer: A network is described as compact because of its design: it uses few hidden layers, few hidden units, or a limited number of parameters. If that same model is trained on a labeled task, it may sometimes perform a little better, but that outcome is not what makes it compact. The definition comes from the architecture, not from the final score.

Key points:

  • Compactness refers to the network architecture.
  • The structural cues are layers, units, and parameter count.
  • Better task performance may happen, but it is only a possible result.
  • The size label does not depend on the metric value.

Rubric: A strong response clearly gives the structural definition, separates it from possible performance gains, and avoids implying that improved accuracy is required for the network to count as compact.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Python Programming Language

Data Science

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI