With a 5% classifier error rate, approximately how large must the Eyeball dev set be to obtain ~100 misclassified examples?

A lower classifier error rate means the Eyeball dev set can be smaller to gather enough errors for analysis.

With a 5% error rate, an Eyeball dev set of _____ examples yields approximately 100 misclassified examples.

Match each Eyeball dev set concept to its correct description.

Order the steps for determining the required Eyeball dev set size given a classifier's error rate.

Why does a lower classifier error rate require a larger Eyeball dev set?

A classifier with a 10% error rate needs an Eyeball dev set of 2,000 examples to obtain ~100 misclassified examples.

The _____ the classifier error rate, the larger the Eyeball dev set must be to accumulate enough misclassified examples.

Match each classifier error rate to the approximate Eyeball dev set size needed for ~100 misclassified examples.

Order the reasoning steps that explain why a lower error rate requires a larger Eyeball dev set.

Analyzing the Relationship Between Error Rate and Eyeball Dev Set Size

Sizing an Eyeball Dev Set for a High-Performing Speech Recognizer

Rationale for a 2,000-Example Eyeball Dev Set at a 5% Error Rate