Limits of Human Inspection in Verifying Synthesized Data Realism
Question: Why is a human's judgment that a synthetic dataset is realistic insufficient for determining whether it is realistic to a computer?
Sample answer: A human judges realism based on human perception, whereas a computer processes data based on detailed statistical properties. Because synthetic data can appear realistic to a person without matching the statistical characteristics required by a computer, human judgment is insufficient.
Key points:
- Humans and computers evaluate data realism using different criteria (perception vs. statistical properties).
- Synthetic data can appear realistic to a person without appearing realistic to a computer.
Rubric: The response must state that humans and computers judge realism differently (perception vs. statistical properties) and that data realistic to a person may still lack the realism required by a computer.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What is the key challenge of artificial data synthesis identified in Machine Learning Yearning?
Synthetic data that appears realistic to a human always appears realistic to a computer as well.
It is sometimes easier to create synthetic data that appears realistic to a _____ than to a computer.
Match each concept to its correct description in the context of the computer realism challenge in data synthesis.
Order the reasoning steps a practitioner should follow when assessing whether synthetic data is suitable for model training.
A team synthesizes car-noise audio that human listeners rate as convincing. What should they do before adding it to training?
Creating synthetic data that appears realistic to a computer is generally harder than creating data that appears realistic to a human.
Synthetic data can appear realistic to a person without appearing _____ to a computer.
Match each scenario to the realism concept it best illustrates: human realism, computer realism, or the gap between them.
Order the steps a team should follow to address the computer realism challenge when incorporating synthetic data into training.
Analyzing the Discrepancy in Human versus Computer Realism for Synthetic Data
Diagnosing a Realism Discrepancy in Synthesized Training Data
Limits of Human Inspection in Verifying Synthesized Data Realism