Question: Explain why establishing an initial dev/test set and a clear evaluation metric is crucial for a machine learning team's development workflow. How do these components specifically affect the team's ability to make progress?

Sample answer: Having an initial dev/test set and metric provides a clear, unified target for the machine learning team. This setup allows them to quickly and objectively evaluate any changes or new ideas they test. As a result, the primary workflow advantage is that it helps the team iterate quickly, avoiding delays caused by uncertainty over whether a modification actually improved the model.

Key points:

• Provides a defined target for the team.
• Allows for the objective evaluation of changes.
• Crucially helps the team iterate quickly.

Rubric: A correct response should explain that an initial dev/test set and metric serve as an evaluation tool that directly enables the team to iterate quickly on their machine learning models.