- **Pros**: According to the study, provides higher accuracy with less training cycles, for problems with high dimensionality 
- **Cons**: Results are unintuitive, difficult to understand “why” hyperparameter values were chosen

University of Michigan - Ann Arbor

According to a 2012 research study by James Bergstra and Yoshua Bengio, testing randomized values of hyperparameters is actually more effective than manual search or grid search. In other words, instead of testing systematically to cover “promising areas” of the problem space, it is preferable to test random values drawn from the entire problem space. 

Random Search for Hyperparameter Tuning Methods in Deep Learning

A helpful website that introduces neural networks:
https://missinglink.ai/guides/neural-network-concepts/

Neural Network Reference

- **Pros**: The original study and practical experience from the industry shows that Bayesian optimization results in significantly higher accuracy compared to random search. 
- **Cons**: Like random search, results are not intuitive and difficult to improve on, even by trained operators.

Learn Before

Related