Hyperparameter

Hyperparameters are parameters of the model that are set before training and affect the behavior and performance of the model.

Hyperparameters of ensemble learning

Grid Search

Random Search

Bayesian Optimization

Ensemble methods for hyperparameter optimization

Hyperparameters of machine learning

Learning rate

The number of trees

The regularization parameter