Case context: A team wants separate development subsets, but its dev set is not big enough to split. The team still needs to examine errors manually, select a model, and tune hyperparameters.

Question: What should the team designate as its Eyeball dev set, and which activities should it perform with that set?

Sample answer: The team should designate the entire dev set as the Eyeball dev set. It should use that set for manual error analysis, model selection, and hyperparameter tuning.

Key points:

• Do not divide a dev set that is not big enough to split.
• Use the entire dev set as the Eyeball dev set.
• Perform manual error analysis with it.
• Use it for model selection and hyperparameter tuning.

Rubric: Full credit requires choosing the entire dev set, naming its Eyeball dev set role, and listing all three supported activities. Partial credit applies when the decision is correct but the activities are incomplete.