Essay

Explain why representativeness matters when synthesizing training data.

Question: Explain, using the source's reasoning, why it matters whether synthesized training examples are representative, and what risk arises when they are not.

Sample answer: Synthesized data is meant to stand in for real-world examples, so if it is generated from a narrow source (like 20 car designs or 1 hour of noise), it will share distinguishing properties that don't reflect the true diversity of real data. A learning algorithm can then pick up on these artificial patterns rather than the genuine signal, causing it to overfit to the synthesis process instead of generalizing to real examples.

Key points:

  • Representativeness means synthesized data should reflect true real-world variation.
  • Narrow source material (e.g., 20 designs, 1 hour of noise) creates distinguishable synthesized data.
  • A distinguishable pattern lets the algorithm exploit artifacts instead of learning genuine signal.
  • This leads to poor generalization on real, non-synthesized examples.

Rubric: Full credit: identifies that limited source material causes distinguishable synthesized data, explains the overfitting/generalization risk, and connects to the specific examples (car designs, car noise). Partial credit: mentions representativeness without explaining the mechanism of distinguishability.

0

1

Updated 2026-07-10

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI