What capability is needed to determine the correct level of investment in dev and test sets?
Question: According to Machine Learning Yearning, deciding exactly how much effort and resources to put into developing great dev and test sets relies on what specific human capability?
Sample answer: It relies on human judgment to decide how much to invest in developing great dev and test sets.
Key points:
- The decision fundamentally requires judgment.
- There is no set rule or formula for the investment.
Rubric: The answer must clearly identify that determining the investment level requires judgment.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
Why does deciding how much to invest in dev and test sets require judgment rather than a fixed formula?
True or False: A universal fixed rule specifies exactly how much to invest in developing great dev and test sets.
According to Machine Learning Yearning, it requires _____ to decide how much to invest in developing great dev and test sets.
Match each dev/test set investment scenario to its most likely outcome.
Order the steps in the judgment-based process for deciding how much to invest in dev and test sets.
A team is building a small internal ML tool with limited resources. How should they approach dev/test set investment per Machine Learning Yearning?
True or False: Developing great dev and test sets always demands the maximum investment effort a team can provide.
Because dev/test set investment requires judgment rather than a fixed rule, the appropriate level of investment _____ from project to project.
Match each project factor to the reason it informs the judgment about dev/test set investment level.
Order the reasoning steps a team should follow when considering reducing their dev/test set investment.
Discuss why the decision on how much to invest in dev and test set development relies on judgment rather than a strict formula.
Allocating resources for a startup's first product dev and test sets.
What capability is needed to determine the correct level of investment in dev and test sets?