Why Synthetic Samples Can Fool People but Not Models
Question: Explain why synthetic data may seem realistic to a person but still fail to satisfy a computer-based check, and describe what that means for validating generated data for machine learning.
Sample answer: People usually judge realism from broad appearance and familiar patterns, while a computer model checks fine-grained statistical relationships in the data. Because of that difference, synthetic examples can look convincing to a human reviewer and still violate the patterns a learning algorithm depends on. Human review is useful, but it is not enough by itself; the generated data also has to be checked against the statistical properties that matter to the model.
Key points:
- Human judgment and model judgment rely on different criteria
- Data can pass a visual or intuitive check and still fail a statistical one
- Human inspection alone is not sufficient for validation
- Model-relevant statistical checks are also required
Rubric: The response must state that synthetic data can look realistic to people without matching computer checks, explain that human and machine judgments differ, and conclude that both human and statistical validation are needed for machine learning use.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What makes synthetic data difficult to use effectively?
Human-likeness guarantees machine-likeness in synthetic data
Synthetic Data Can Look Real to a Human First
Match each synthetic-data concept to the description it best fits in the realism dilemma.
Put the checks in a sensible order when deciding whether generated data is usable for training.
A team generates synthetic café-noise clips that human listeners say sound convincing. What should they check before using them for training?
Synthetic examples that seem believable to people are often easier to make than examples that match a model's learned patterns.
A generated image can look ____ to a person while still triggering a detector that says it was synthesized.
Match Each Scenario to the Correct Realism Concept
Order the steps for checking whether synthetic customer-support chats are useful for training.
Why Synthetic Samples Can Fool People but Not Models
Testing Whether Synthetic Data Works for a Model
Why Human Approval Does Not Prove Synthetic Data Works for a Model