Case Study

Addressing a plateauing logistic regression model

Case context: You are working on a classification problem and have started with a logistic regression model. Over the past year, your team has collected ten times as much training data as you originally had. You train the model on this massive new dataset, hoping for a significant jump in accuracy. However, upon testing, the model's accuracy has barely increased at all.

Question: Based on the concept of older algorithms plateauing, diagnose why the logistic regression model's accuracy has not improved and explain what this implies about the model's capacity to handle your new data.

Sample answer: The logistic regression model has likely reached a performance "plateau." This means its learning curve has flattened out because it is an older learning algorithm. As a result, it stops improving even though you have provided it with significantly more data. This implies that the algorithm lacks the capacity to figure out what to do with all the new data and cannot extract further meaningful patterns from the increased volume.

Key points:

  • Diagnose the issue as a performance plateau.
  • Explain that logistic regression is an older algorithm.
  • Note that the learning curve has flattened out.
  • State that the algorithm cannot utilize the additional data effectively.

Rubric: The response should correctly diagnose the issue as a performance plateau and explain that logistic regression, as an older algorithm, eventually stops improving and its learning curve flattens out, showing an inability to utilize vast amounts of data.

0

1

Updated 2026-06-19

Contributors are:

Who are from:

Tags

Machine Learning

Deep Learning

Supervised Learning

Dive into Deep Learning @ D2L

Data Science

Machine Learning Strategy

Machine Learning Yearning @ DeepLearning.AI