Essay

Analyzing the relationship between model size and data volume

Question: Explain why simply having a very large neural network is not sufficient for achieving the 'best performance'. What is the other necessary component and how do they interact?

Sample answer: While training a very large neural network provides the capacity to learn highly complex functions, it requires a huge amount of data to achieve the best performance. Without huge data, the large network cannot reach its full potential. The two factors work together: the huge data provides the extensive examples necessary for the large network to learn effectively, allowing the combined system to reach the highest performance levels.

Key points:

  • A very large neural network is required.
  • A huge amount of data is the second necessary component.
  • Both are required simultaneously for the 'best performance'.

Rubric: The response must explicitly mention the need for a 'huge amount of data' alongside a large neural network. It should explain that the two components must be combined to achieve the best performance.

0

1

Updated 2026-06-13

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI