Question: Explain why the content of the development set determines the main target for model improvement. What is the consequence if the development set leaves out important parts of the real deployment problem?

Sample answer: After the development and test sets are fixed, the team usually tries to make progress on development-set performance. That means the development set becomes the practical target for model iteration. If it does not include the situations that matter most in deployment, the team may spend effort improving the wrong objective. The result is a model that looks better on the chosen benchmark but does not improve where the project actually needs it most.

Key points:

• The development set becomes the main reference for iteration and improvement.
• If it misses important real-world cases, optimization can drift away from the true goal.
• A good development set should represent the deployment task the team cares about most.

Rubric: The answer must state that teams optimize against development-set performance and explain that an unrepresentative development set causes effort to be spent on the wrong or incomplete objective.