Learn Before
Interpreting a Performance Error Table
Question: In a model review table used to compare performance across two data sources, how is the table organized, and why is it useful to fill in the extra cells?
Sample answer: The table uses one axis for the two data sources being compared and the other axis for three error categories: human-level error, error on data the model was trained to handle, and error on data it has not seen in training. Completing the extra cells helps reveal whether the model is struggling differently on the two sources, which makes it easier to diagnose the underlying problem.
Key points:
- One axis lists the two data sources or distributions.
- The other axis lists human-level error, error on trained data, and error on untrained data.
- Extra cells help expose differences in behavior across the two sources.
Rubric: A strong answer should identify both axes correctly and explain that the additional entries provide diagnostic information about how the model behaves across the two data sources.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
In a comparison table for a speech recognizer, what belongs on the x-axis?
In the error table, the horizontal axis shows three different data distributions.
The diagnostic table compares two data _____ across the top and lists three error categories down the side.
Match each table axis or row label to its role in comparing errors across two data sets.
Order the steps for building a comparison table for two data groups.
What is one advantage of adding more entries to a diagnostic error table?
A table can make it easier to compare different kinds of errors across training and development sets.
One row in an error table reports performance on examples the model has _____.
Match each table comparison to the diagnostic insight it provides.
Steps for Interpreting an Error Table Across Two Data Sources
Interpreting a Performance Error Table
Building an error table for a model evaluated on two image streams.
Name the three error rows in the error table