Question: What is the consequence if your initial cat app dev/test set had mainly pictures of adult cats, but users later upload many kitten images?

Sample answer: The consequence is that the dev/test set distribution is not representative of the actual distribution you need the system to do well on.

Key points:

• Dev/test set is not representative
• Actual distribution mismatch

Rubric: Must state that the dev/test set is unrepresentative of the actual distribution.