Case Study

What can a team conclude after checking a small batch of model mistakes?

Case context: A team manually inspects 18 errors made by a text classifier on recent validation examples. The review suggests that a few error categories explain many of the mistakes.

Question: What conclusion is justified from this review, using only what the evidence supports?

Sample answer: The team can conclude that it has a rough early sense of the model's main error categories. It should not claim a complete or exact diagnosis, because reviewing 18 mistakes only supports a preliminary view.

Key points:

  • Manual review of 18 mistakes
  • Validation examples
  • Main error categories
  • Rough initial understanding rather than a complete account

Rubric: Full credit requires stating that the review gives only a rough sense of the major error categories and does not justify claiming complete or exact knowledge.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Machine Learning Strategy

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Yearning @ DeepLearning.AI