Viet-Anh on Software Logo

What is: Random Search?

Year2000
Data SourceCC BY-SA - https://paperswithcode.com

Random Search replaces the exhaustive enumeration of all combinations by selecting them randomly. This can be simply applied to the discrete setting described above, but also generalizes to continuous and mixed spaces. It can outperform Grid search, especially when only a small number of hyperparameters affects the final performance of the machine learning algorithm. In this case, the optimization problem is said to have a low intrinsic dimensionality. Random Search is also embarrassingly parallel, and additionally allows the inclusion of prior knowledge by specifying the distribution from which to sample.

Extracted from Wikipedia

Source Paper

Image Source: BERGSTRA AND BENGIO