The Sequential Parameter Optimization Toolbox (SPOT) provides a set of tools for model-based optimization and tuning of algorithms. It includes surrogate models, optimizers, and design of experiment approaches. The main interface is spot, which uses sequentially updated surrogate models for the purpose of efficient optimization. The main goal is to ease the burden of objective function evaluations, when a single evaluation requires a significant amount of resources.
For more than 15 years, SPOT is used as an efficient and effective hyperparameter optimization (HPO) tool. The figure below shows results from the 2005 CEC paper: performance of a particle swarm optimization with default and tuned hyperparameters.
spotPython: Software and Documentation
spot is available as a python (“spotPython”) package:
[Hyperparameter Tuning Cookbook]: https://sequential-parameter-optimization.github.io/Hyperparameter-Tuning-Cookbook/
The related package spotRiver implements tools for analyzing and tuning of River:
Python: Software and Doumentation
The Python tutorial: https://docs.python.org/3/tutorial/.
The R version of SPOT is not maintained any more.
SPOT (Core Package, Version 2.11.14)
SPOT is open source and can be downloaded from CRAN:
The most recent SPOT version is available here (Hint for Safari users: use right-click download for downloading the compressed *.tar.gz archive):
SPOT can be installed with the following command, where “~/Downloads/” is the name of the local folder:
install.packages("~/Downloads/SPOT_LATEST.tar.gz", repos=NULL, type="source")
SPOTMisc (Additional Features, Version 1.19.52)
SPOTMisc implements additional functions. It is open source and can be downloaded from CRAN:
The most recent SPOT version is available here:
SPOTMisc can be installed with the following command, where “~/Downloads/” is the name of the local folder:
install.packages("~/Downloads/SPOTMisc_LATEST.tar.gz", repos=NULL, type="source")
After successful installation, the package versions can be checked as follows:
packageVersion("SPOT")  ‘2.11.14’ packageVersion("SPOTMisc")  ‘1.19.52’
spotGUI (Graphical User Interface)
A graphical user interface for the Sequential Parameter Optimization Toolbox (package ‘SPOT’). It includes a quick, graphical setup for spot, interactive 3D plots, export possibilities and more.
The old reference from 2005:
- T. Bartz-Beielstein, C.W.G. Lasarczyk, and M. Preuss. Sequential parameter optimization. In Evolutionary Computation, 2005. The 2005 IEEE Congress on, volume 1, pages 773–780, New York, NY, USA, Sept 2005. IEEE.
- Bartz-Beielstein, T., Zaefferer, M., and Rehbach, F. In a Nutshell – The Sequential Parameter Optimization Toolbox. arXiv e-prints (Dec. 2021), https://arxiv.org/abs/1712.04076.