Learn Before
Reducing Variance After Adding Diagnostic Features
Case context: A machine learning engineer reviews errors in a bank card fraud detector and finds that it misses a group of transactions with an unusual combination of merchant category and time-of-day patterns. To address that specific weakness, the engineer adds new engineered input features that highlight those patterns. The training error falls, but validation performance now shows a noticeable rise in variance.
Question: According to the standard approach for handling this tradeoff after improving bias with new features, what should the engineer do next to address the increased variance?
Sample answer: The engineer should apply regularization, which is the usual next step for reducing the variance that can appear after adding features intended to lower avoidable bias.
Key points:
- The added features were designed to reduce avoidable bias in a targeted error category.
- The side effect observed was an increase in variance.
- Regularization is the appropriate technique for counteracting that variance increase.
Rubric: The answer must correctly identify regularization as the needed intervention to address the rise in variance.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Machine Learning Yearning @ DeepLearning.AI
Related
What should you do if adding new features raises variance?
Do Newly Added Inputs Affect Only One Source of Error?
Improving Features from _____ Findings
Roles in Adding New Features
Steps for Adding a New Feature After Error Review
Why Extra Features Can Backfire Temporarily
Reducing Variance After Adding Diagnostic Features
Purpose of New Inputs After Review
How Error Analysis Can Shape New Features
Regularization Can Offset Added Variance