The paper “In a Nutshell: Sequential Parameter Optimization” has been assigned the permanent arXiv identifier 1712.04076 and is available at:
Date: Tue, 12 Dec 2017 00:03:45 GMT (2255kb,D)
Title: In a Nutshell: Sequential Parameter Optimization
Authors: Thomas Bartz-Beielstein, Lorenzo Gentile, Martin Zaefferer
Categories: cs.MS cs.AI math.OC
Comments: Version 12/2017
The performance of optimization algorithms relies crucially on their
parameterizations. Finding good parameter settings is called algorithm tuning.
Using a simple simulated annealing algorithm, we will demonstrate how
optimization algorithms can be tuned using the sequential parameter
optimization toolbox (SPOT). SPOT provides several tools for automated and
interactive tuning. The underling concepts of the SPOT approach are explained.
This includes key techniques such as exploratory fitness landscape analysis and
response surface methodology. Many examples illustrate how SPOT can be used for
understanding the performance of algorithms and gaining insight into
algorithm’s behavior. Furthermore, we demonstrate how SPOT can be used as an
optimizer and how a sophisticated ensemble approach is able to combine several
meta models via stacking.