Concept
Using the log scale to pick Hyperparameters in Deep Learning
When manually picking hyperparameters it is important to use a good scale (especially if you are randomly picking values along an interval). This is especially relevant when tuning the learning rate alpha or any other hyperparameter where minor changes in values at the end of your interval can drastically improve performance. Using the log scale can help you distribute your resources more efficiently and ensure you sample a suitable number of values at the extreme lower/higher side of your chosen interval.
0
2
Updated 2020-11-16
Contributors are:
Who are from:
Tags
Data Science