created:: 2023-09-23T22:17:09
up:: Hyperparameter Optimization
tags:: #🌱 #machine-learning

Bayesian search is one of the advanced techniques to do hyperparameter optimization. It uses some kind of statistics and algorithm involved (Bayesian Statistics) to estimate/predict the best hyperparameter or knob settings.

Below is the result of the performance compared to Grid Search and Random Search optimization technique.

Related:

• Bayesian Statistics
• Hyperparameter Optimization Techniques
• Hyperparameter Optimization

Resources

• Grid search and random search are outdated. This approach outperforms both

• Soleymani, A. (2023). Grid search and random search are outdated. This approach outperforms both. Retrieved from https://medium.com/@ali.soleymani.co/stop-using-grid-search-or-random-search-for-hyperparameter-tuning-c2468a2ff887. Accessed 23 Sept. 2023.