Decide which wake word detector should be chosen under the stated performance framework.
Case context: A team compares several microphone-based wake word detectors. Some exceed one false positive every 24 hours of operation. The remaining detectors meet that limit but differ in how often they miss a spoken wake word.
Question: How should the team screen and compare these detectors, and what property should determine the final choice?
Sample answer: The team should first reject any detector that exceeds one false positive every 24 hours because it fails the satisficing requirement. It should then compare the false negative rates of the remaining detectors and select the one with the lowest rate, since false negative rate is the optimizing metric.
Key points:
- Exclude detectors that violate the false-positive limit.
- Treat one false positive every 24 hours as the maximum acceptable frequency.
- Compare false negative rates only among qualifying detectors.
- Choose the qualifying detector with the lowest false negative rate.
Rubric: The response should apply the false-positive threshold as an eligibility constraint and then use minimum false negative rate to choose among eligible detectors.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Which performance goal correctly assigns the wake word system's optimizing and satisficing metrics?
Is a wake-up when nobody said the wake word a false positive?
The proposed goal minimizes the _____ rate while constraining false positives.
Match each wake word metric concept to its meaning or role.
Order the reasoning used to evaluate wake word detectors under the proposed goal.
Explain why the two wake word error rates have different roles in the proposed performance goal.
Decide which wake word detector should be chosen under the stated performance framework.
What two events do the wake word detector's false positive and false negative rates measure?
Which detector is eligible for optimization under the proposed false-positive constraint?
Can a detector with the lowest false negative rate still fail the proposed overall goal?