Essay

Explain why small training subsets can make learning curves noisy.

Question: In a concise analytical response, explain how random subset composition, ambiguous or mislabeled examples, class skew, and many-class data contribute to noisy learning-curve points.

Sample answer: Each point at a small training-set size may be based on a random subset that does not represent the full dataset well. An unlucky subset can contain many ambiguous or mislabeled examples and produce worse-than-expected error, while a lucky subset can produce better-than-expected error. Heavy class skew and a huge number of classes further increase the chance that a small subset omits or underrepresents important classes. Training and dev errors may therefore fluctuate at the smaller training-set sizes.

Key points:

  • Small random subsets may be unrepresentative
  • Ambiguous or mislabeled examples can create a particularly bad subset
  • A lucky subset can yield better-than-expected values
  • Class skew increases the risk of poor class representation
  • A huge number of classes increases the risk of an unrepresentative subset

Rubric: A strong response clearly links small random subsets to error fluctuation, contrasts unusually good and bad subsets, and explains why skewed or many-class data increases unrepresentativeness. Award full credit only when the explanation remains grounded in the supplied evidence.

0

1

Updated 2026-07-19

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI