Building a Tree-Structured Parzen Estimator from Scratch (Kind Of) | by Colin Horgan | Apr, 2023
An alternative to traditional hyperparameter tuning methodsVisualization of TPE for 2-dimensional hyperparameter tuning. Image by Alexander Elvers via Wikipedia Commons.The way a machine learning model fits itself to data is governed by a set of initial conditions called hyperparameters. Hyperparameters help to restrict the learning behavior of a model so that it will (hopefully) be able to fit the data well and within a reasonable amount of time. Finding the best set of hyperparameters (often called “tuning”) is one of…