Short Answer

Neural Network Capacity and Irrelevant Training Data

Question: Besides wasting computational resources, what other negative impact does including unbeneficial training data (like scanned text in a casual photo detector) have on a neural network?

Sample answer: Including unbeneficial training data wastes the neural-network's representation capacity by forcing it to represent features that do not help with the target dev/test distribution.

Key points:

  • Wastes neural-network representation capacity.
  • Forces the network to allocate parameters/capacity to irrelevant features.

Rubric: The response must state that it wastes the representation capacity of the neural network.

0

1

Updated 2026-05-26

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Related