Why Latency Is a Satisficing Metric
Question: In the example, why is response latency treated as a satisficing metric instead of an optimizing metric?
Sample answer: Response latency is a satisficing metric because the system only needs to be fast enough to meet a practical threshold, such as responding within 150 ms. Once that standard is met, making it even faster is less important than improving the main quality goal.
Key points:
- It only needs to be good enough, not endlessly improved.
- It is judged against an acceptable threshold, such as 150 ms.
Rubric: The answer should say that response latency only has to meet an acceptable threshold or be good enough, rather than being improved without limit.
0
1
Tags
D2L
Dive into Deep Learning @ D2L
Machine Learning
Deep Learning
Supervised Learning
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Acceptable-Threshold Metric
Primary Optimization Metric
Using Hard Limits and One Score to Compare Models
Using Two Error Rates in a Voice-Trigger Goal
Shared Evaluation Metric Lets a Team Move Faster
Latency limit versus F1 score
What Counts as a Satisficing Metric
Combining Multiple Evaluation Criteria
Choosing the Right Evaluation Metric
Applying Satisficing and Optimizing Metrics
Explaining Optimizing and Satisficing Metrics
Choosing a deployment metric under a hard device limit
Why Latency Is a Satisficing Metric
What does a satisficing metric ask for?
When a system has both an optimizing metric and a satisficing metric, the best plan is to maximize the optimizing metric even if the satisficing metric is violated.