Essay

Explain why plentiful data does not by itself justify an extremely large Eyeball dev set.

Question: In a concise analytical response, explain what should control Eyeball dev set size when data is plentiful and how the source's 1,000-error observation supports that reasoning.

Sample answer: When data is plentiful, the limiting factor is not the supply of examples but the number that a person or team has time to analyze manually. The Eyeball dev set should therefore be sized around realistic manual-analysis capacity. The observation that the author has rarely seen anyone manually analyze more than 1,000 errors illustrates that this capacity is practically limited, even when many examples are available.

Key points:

  • Plentiful data is the stated condition.
  • Manual-analysis capacity mainly determines set size.
  • More than 1,000 manually analyzed errors is rare.
  • The 1,000-error observation is not presented as a required size.

Rubric: A strong response identifies manual-analysis time as the main sizing determinant, distinguishes data availability from analysis capacity, and accurately interprets the 1,000-error statement as a rare observation rather than a mandatory cutoff.

0

1

Updated 2026-07-19

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI