Learn Before
What is the key lesson from this content moderation example about evaluation metrics?
A moderation model has the best overall accuracy on a test set, but it still lets a small category of clearly prohibited posts reach users. That failure would be serious in production even though the summary metric looks strong.
0
1
Tags
Machine Learning
Deep Learning
Machine Learning Strategy
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Yearning @ DeepLearning.AI
Related
In a family photo app example, why is classifier A still unacceptable even though its accuracy is higher?
True or False: A model with the highest overall accuracy is always the best choice for detecting a rare equipment defect.
A model can still be unacceptable if it misses the wrong kind of case
Match each item in the content-filter example to the statement that best describes it.
Order the reasoning that shows accuracy can be the wrong metric in a loan approval classifier example.
Why overall accuracy can miss the real goal in a content-filtering app
A radiology AI team must choose between two models after testing exposes a critical miss.
Why the higher-accuracy classifier is still rejected
True or False: Model 27 is the one that occasionally lets spam messages pass through.