Learn Before
What Guides Dev/Test Investment Decisions?
Question: According to a machine learning strategy guide, what human capability is needed to decide how much effort and resources to spend on building high-quality dev and test sets?
Sample answer: It depends on human judgment to choose the right level of investment.
Key points:
- There is no fixed formula for the decision.
- Teams must weigh the tradeoff using judgment.
Rubric: The answer must identify human judgment as the basis for choosing the investment level.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Why is there no universal rule for how much effort to put into the development and test sets?
True or False: There is one fixed rule that always tells a team how much effort to spend on building strong dev and test sets.
Deciding how much to invest in dev and test sets takes _____ .
Match each evaluation-set investment choice to its most likely result.
Put the judgment steps for sizing dev and test set investment in order.
Planning Dev and Test Data for a Small ML Project
True or False: Building high-quality development and test sets always requires the largest effort a team can possibly spend.
Why Dev and Test Set Spending Is Project-Specific
Match each project factor to why it changes how much you should invest in dev and test sets.
Order the steps for deciding whether to spend less effort on evaluation.
Why Dev and Test Set Planning Depends on Judgment
Choosing a budget for dev and test data in a startup
What Guides Dev/Test Investment Decisions?