Learn Before
What is an optimizing metric in model selection?
Question: In a few words, explain what an optimizing metric is and name the metric used for the classifier example.
Sample answer: An optimizing metric is the measure you try to make as good as possible after the essential pass/fail requirements have been set. In the classifier example, the optimizing metric is accuracy, because the model is chosen to maximize accuracy once the speed requirement is satisfied.
Key points:
- It is the metric used for choosing among acceptable options
- It is considered after required constraints are set
- Accuracy is the example optimizing metric in the classifier case
Rubric: Full credit for defining it as the metric to maximize after required constraints are met and for naming accuracy in the example. Partial credit for an incomplete but directionally correct definition.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What is the optimizing metric in this fraud-screening example?
True or False: Satisficing criteria are usually set before choosing the final optimizing metric.
What metric is maximized in the classifier example after meeting the speed requirement?
Match each metric role to its meaning in a mobile app ranking task.
Order the steps for choosing the optimization target in a mobile app example.
Distinguish an Optimizing Metric from a Satisficing Metric
Choose the Metric to Maximize After Setting a Time Limit
What is an optimizing metric in model selection?
When Does a Metric Become the Optimizing Metric?
For a mobile classifier that must answer within 150 milliseconds, inference speed is the metric to maximize and accuracy only has to clear a minimum cutoff.