Learn Before
Case Study

Selecting the next improvement step after a first model is built

Case context: A small team has completed an initial spam classifier for customer support messages. They now have several possible ways to improve it: gather more labeled examples, train the current network for extra epochs, or redesign the feature pipeline. One teammate wants to inspect the model’s mistakes first to see what pattern the errors reveal, while another wants to begin a long six-month labeling project right away.

Question: In terms of machine learning strategy, evaluate the two proposals. Which approach should guide the team’s next decision, and what could happen to the project schedule if they choose badly?

Sample answer: The team should start by examining the errors and other clues from the current system before committing to a new direction. Those clues show which kinds of changes are likely to help and which are unlikely to matter. If they jump into an expensive labeling effort without checking whether it addresses the real weakness, they may lose many months. Reading the evidence first can prevent that mistake and may save months or even years of development time.

Key points:

  • Error patterns can indicate which fixes are promising and which are not.
  • Picking the next step without that analysis can waste many months.
  • Careful diagnosis before acting can save a large amount of development time.

Rubric: The response must recommend inspecting the current model’s errors or clues before choosing a next step. It must explain that these clues help identify useful versus unhelpful directions. It must state that a poor choice can waste months, while using the clues first can save months or years of development time.

0

1

Updated 2026-08-12

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI