Learn Before
Identify the primary criterion for a dev set's composition.
Question: According to the ML Yearning framework, what specific task must the composition of a development (dev) set reflect?
Sample answer: The dev set should reflect the specific task that the machine learning team wants to improve on the most, as this dataset becomes the primary target for all subsequent model optimization efforts.
Key points:
- Must reflect the task the team most wants to improve on.
- It dictates the team's primary optimization focus.
Rubric: The answer should explicitly state that the dev set must reflect the task the team most wants to improve on.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Why should the dev set reflect the task you most want to improve on?
After defining dev and test sets, a team's primary optimization focus becomes improving dev set performance.
The dev set should reflect the _____ the team most wants to improve on.
Match each dataset or concept to its role in the ML Yearning framework for dev and test sets.
Order the steps in the reasoning process for ensuring a dev set reflects the target task.
A team wants performance across four geographies but their dev set covers only two. What is the likely consequence?
A dev set covering only a subset of target deployment scenarios will cause the team to optimize for an incomplete version of the task.
Once you define the dev and test sets, your team will be focused on improving _____ performance.
Match each dev set design choice to the optimization outcome it produces.
Order the consequences that unfold when a dev set does NOT reflect the full target task.
Explain the relationship between dev set composition and optimization focus.
Evaluating dev set representativeness for a multi-region deployment.
Identify the primary criterion for a dev set's composition.