Learn Before
What two kinds of guidance does a single-number score provide?
Question: In one to three sentences, describe the two kinds of guidance a single-number evaluation score gives a development team.
Sample answer: It lets the team rank candidate models against one another using a common score, and it also shows whether changes are moving performance in a better direction. That makes it easier to decide what to try next.
Key points:
- A way to rank models or ideas
- A way to tell whether progress is improving
Rubric: The response should mention both the ability to compare candidates and the ability to see whether progress is moving in the right direction.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Precision for a Cat Detector
Recall for a Positive-Class Detector
One Score from Precision and Recall
Averaging Several Metrics into One Score
Using a Dev Set to Compare Model Versions
What is the main advantage of using one evaluation score while developing models?
A single score can help a team rank many models quickly.
Single-number metrics for model selection
Match each development choice to its role in testing model ideas.
Put the model-selection process with one metric in order.
Why a single evaluation score speeds model development
Use one primary score to compare many candidate models.
What two kinds of guidance does a single-number score provide?
What evaluation strategy best helps you choose quickly among many model candidates?
A single evaluation score can help a team choose among competing models and point the team toward the next improvement.