Why must the same label-fixing process applied to the dev set also be applied to the test set?

Fixing only dev set labels without applying the same process to the test set can cause the two sets to be drawn from different distributions.

Whatever process you apply to fixing dev set labels, you must also apply it to the _____ labels.

Match each label-fixing scenario to its consequence for dev/test set evaluation.

Order the steps for correctly fixing mislabeled examples while keeping dev and test sets from the same distribution.

What is the primary risk when a team optimizes against a dev set whose labels were fixed differently from the test set?

Applying different label-fixing methods to dev and test sets is acceptable as long as both sets achieve high overall label accuracy.

Fixing dev and test set labels together prevents the team from optimizing for dev set performance only to be judged on a _____ criterion.

Match each key concept from the label-fixing principle to its correct definition.

Order the events that lead to misaligned evaluation when only dev set labels are fixed and not test set labels.