Addressing a plateauing logistic regression model
Case context: You are working on a classification problem and have started with a logistic regression model. Over the past year, your team has collected ten times as much training data as you originally had. You train the model on this massive new dataset, hoping for a significant jump in accuracy. However, upon testing, the model's accuracy has barely increased at all.
Question: Based on the concept of older algorithms plateauing, diagnose why the logistic regression model's accuracy has not improved and explain what this implies about the model's capacity to handle your new data.
Sample answer: The logistic regression model has likely reached a performance "plateau." This means its learning curve has flattened out because it is an older learning algorithm. As a result, it stops improving even though you have provided it with significantly more data. This implies that the algorithm lacks the capacity to figure out what to do with all the new data and cannot extract further meaningful patterns from the increased volume.
Key points:
- Diagnose the issue as a performance plateau.
- Explain that logistic regression is an older algorithm.
- Note that the learning curve has flattened out.
- State that the algorithm cannot utilize the additional data effectively.
Rubric: The response should correctly diagnose the issue as a performance plateau and explain that logistic regression, as an older algorithm, eventually stops improving and its learning curve flattens out, showing an inability to utilize vast amounts of data.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
Effect of more data on logistic regression
Older algorithms know what to do with all data
Learning curve of older algorithms _____ out
Terms related to algorithm performance plateaus
The process of an older algorithm reaching a plateau
Explaining performance plateaus in older algorithms
Addressing a plateauing logistic regression model
Logistic regression performance with large data
Identifying a plateauing algorithm
Plateaus mean learning curves flatten