Case Study

Guiding a New Analyst on Error Analysis

Case context: A team has built a voice-command classifier for a home assistant. After reviewing several mistakes with the usual error-analysis slices from training, they still see confusing failures on short commands and noisy recordings. A new analyst says they should stop because they have already used the standard process.

Question: How should you respond, given that there is not one universally correct way to do error analysis?

Sample answer: I would explain that the usual slices and checklists are useful starting points, but they do not cover every situation. Because there is no single correct recipe for error analysis, the team should keep investigating and try additional ways of grouping and inspecting the errors, especially the unusual cases that the standard checks missed.

Key points:

  • State that error analysis does not have only one correct method.
  • Treat common patterns as helpful starting tools, not the full solution.
  • Encourage trying new slices, groupings, or inspection methods.

Rubric: A correct response should reject the idea that the standard process is the only valid one and should advise exploring other analysis approaches to understand the remaining errors.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI