Learn Before
What should a development set be designed to match?
Question: What should the composition of a development set match when a machine learning team is deciding what to improve?
Sample answer: It should match the specific task or error pattern that the team most wants to improve, so model tuning is guided by the team’s main priority.
Key points:
- The dev set should be built around the team’s main improvement target.
- It should guide optimization toward the most important task for the project.
Rubric: The answer should clearly state that the development set must reflect the task the team most wants to improve.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Why should the development set track the task you care most about improving?
After the development and test sets are defined, the team usually starts tuning the model to improve development set performance.
Choose the word that completes the statement about dev-set design.
Match each machine learning set or idea to its purpose.
Put the evaluation-set planning steps in the correct order.
A team needs good results in four regions, but its development set samples only two of them. What is the most likely consequence?
If a validation set leaves out important real-world conditions, the team may optimize the wrong problem.
After the data splits are chosen, the team will mainly optimize for _____ performance.
How dev-set coverage changes the direction of optimization
Order the outcomes when a development set leaves out part of the real task.
Why Does the Development Set Shape What the Team Improves?
Making a development set match the real deployment mix
What should a development set be designed to match?