Case Study

Choose a pipeline component design for a small labeled dataset.

Case context: A team is building a document-processing pipeline. For one step in the pipeline, they have only a small labeled dataset from which to learn the step's behavior. They are debating whether that step should be implemented with a simple rule or a highly flexible model.

Question: What should the team conclude about the proposed component design, and what choice should they make given the limited amount of labeled data?

Sample answer: They should first judge whether the component's behavior is simple enough to be learned reliably from the small dataset they have. Because the available data is limited, the safer choice is a simpler component rather than a highly flexible one. A simpler function is more likely to be learned well with modest data, while a more complex design would be harder to train reliably under the same constraints.

Key points:

  • The decision should be based on whether the component is simple enough for the available data.
  • Limited labeled data favors a simpler design.
  • Highly flexible designs are less suitable when data is scarce.
  • The component choice should match model complexity to data availability.

Rubric: Full credit: response explains that the team should evaluate simplicity relative to data availability and choose the simpler component because the dataset is small. Partial credit: response addresses only the evaluation or only the choice. No credit: response does not connect component complexity to the amount of labeled data.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI