Using Two Error Rates in a Voice-Trigger Goal
For a device that listens for a spoken trigger phrase, both kinds of mistakes matter: missing the phrase and reacting when it was not spoken. A practical goal is to reduce the false negative rate, while also requiring that the false positive rate stay below one false alarm per 24 hours of use.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Acceptable-Threshold Metric
Primary Optimization Metric
Using Hard Limits and One Score to Compare Models
Using Two Error Rates in a Voice-Trigger Goal
Shared Evaluation Metric Lets a Team Move Faster
Latency limit versus F1 score
What Counts as a Satisficing Metric
Combining Multiple Evaluation Criteria
Choosing the Right Evaluation Metric
Applying Satisficing and Optimizing Metrics
Explaining Optimizing and Satisficing Metrics
Choosing a deployment metric under a hard device limit
Why Latency Is a Satisficing Metric
What does a satisficing metric ask for?
When a system has both an optimizing metric and a satisficing metric, the best plan is to maximize the optimizing metric even if the satisficing metric is violated.
Learn After
Which metric setup best fits a voice-activation detector goal?
A device that turns on when no trigger phrase was spoken has produced a false positive.
In a voice-trigger system, the objective is to reduce the _____ rate while keeping false alarms low.
Match each trigger-detection metric term to its meaning in a smart speaker system.
Order the steps for comparing wake word systems under a dual-objective goal.
Why do the two wake-word error rates serve different purposes in the target goal?
Choose a warehouse sensor under a hard false-alarm limit.
What do false positives and false negatives mean in an alert system?
Which detector satisfies the false-alarm constraint and can be optimized?
Can a detector meet the best missed-detection rate and still fail the overall requirement?