Case Study

Spotting a New Error Category During Review

Case context: You are analyzing mistakes made by a document OCR system. Your current spreadsheet has four error labels: faint text, tilted page, low resolution, and cropped margins. After reviewing 60 misread pages, you notice that 14 of them are partially covered by a rubber stamp, which does not fit any of the existing labels.

Question: According to good error-review practice, what should you do next in your analysis spreadsheet, and what should you ask about those 14 pages?

Sample answer: I should add a new column for a fresh category such as "Stamped over" or "Text covered by stamp" so that this repeated pattern is tracked separately. While examining those 14 pages, I should also ask whether a person could still have read the text accurately despite the stamp, since that may point to a useful fix.

Key points:

  • Add a new error category column to the spreadsheet.
  • Base the new label on the repeated pattern found during manual review.
  • Ask whether a human could have labeled the page correctly despite the obstruction.

Rubric: The response should clearly say that a new error category should be added to the spreadsheet. It should also state that the reviewer should ask whether or how a human could have read the affected pages correctly.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI