Learn Before
Feature Selection for Variance Reduction
Feature selection can reduce variance by decreasing the number or type of input features, but it can also increase bias. Small reductions in feature count are unlikely to have a large bias effect, while large reductions are more likely to matter, especially if too many useful features are excluded. In modern deep learning with plentiful data, practitioners are more likely to provide all features and let the algorithm learn which to use, but feature selection can still be useful when the training set is small.
0
1
Tags
Machine Learning
Deep Learning
Supervised Learning
Dive into Deep Learning @ D2L
Data Science
Machine Learning Strategy
Learn After
What two opposing effects can feature selection have on a model's error components?
Reducing input features from 1,000 to 900 is unlikely to have a large effect on model bias.
In modern deep learning with plentiful data, practitioners are more likely to give _____ features to the algorithm and let it sort out which ones to use.
Match each feature reduction scenario to its likely impact on model bias according to Machine Learning Yearning.
Order the reasoning steps for deciding whether to apply feature selection as a variance-reduction technique.
According to Andrew Ng, under which specific condition is feature selection described as 'very useful'?
In modern deep learning with plentiful data, practitioners have largely shifted away from manual feature selection.
Reducing features from 1,000 to _____ is described as a ~10× reduction that is more likely to have a significant effect on bias.
Match each concept to its correct description in the context of feature selection for variance reduction.
Order the steps for evaluating how much a proposed feature reduction will affect model bias.
Trade-offs of Feature Selection in Deep Learning
Optimizing Features for a Medical Image Classifier
Impact of Plentiful Data on Feature Selection