An online version of the paper “Optimization via multimodel simulation” (https://doi.org/10.1007/s00158-018-1934-2) written by Thomas Bartz-Beielstein, Martin Zaefferer, and Quoc Cuong Pham was published today. This research paper was published in the journal “Structural and Multidisciplinary Optimization“.
“Increasing computational power and the availability of 3D printers provide new tools for the combination of modeling and experimentation. Several simulation tools can be run independently and in parallel, e.g., long running computational fluid dynamics simulations can be accompanied by experiments with 3D printers. Furthermore, results from analytical and data-driven models can be incorporated. However, there are fundamental differences between these modeling approaches: some models, e.g., analytical models, use domain knowledge, whereas data-driven models do not require any information about the underlying processes. At the same time, data-driven models require input and output data, but analytical models do not. The optimization via multimodel simulation (OMMS) approach, which is able to combine results from these different models, is introduced in this paper. We believe that OMMS improves the robustness of the optimization, accelerates the optimization-via-simulation process, and provides a unified approach. Using cyclonic dust separators as a real-world simulation problem, the feasibility of this approach is demonstrated and a proof-of-concept is presented. Cyclones are popular devices used to filter dust from the emitted flue gasses. They are applied as pre-filters in many industrial processes including energy production and grain processing facilities. Pros and cons of this multimodel optimization approach are discussed and experiences from experiments are presented.”
Combined simulation Multimodeling Simulation-based optimization Metamodel Multi-fidelity optimization Stacking Response surface methodology 3D printing Computational fluid dynamics
Cite this article as
Bartz-Beielstein, T., Zaefferer, M. & Pham, Q.C. Struct Multidisc Optim (2018). https://doi.org/10.1007/s00158-018-1934-2
Springer Berlin Heidelberg
The paper “In a Nutshell: Sequential Parameter Optimization” has been assigned the permanent arXiv identifier 1712.04076 and is available at:
Date: Tue, 12 Dec 2017 00:03:45 GMT (2255kb,D)
Title: In a Nutshell: Sequential Parameter Optimization
Authors: Thomas Bartz-Beielstein, Lorenzo Gentile, Martin Zaefferer
Categories: cs.MS cs.AI math.OC
Comments: Version 12/2017
The performance of optimization algorithms relies crucially on their
parameterizations. Finding good parameter settings is called algorithm tuning.
Using a simple simulated annealing algorithm, we will demonstrate how
optimization algorithms can be tuned using the sequential parameter
optimization toolbox (SPOT). SPOT provides several tools for automated and
interactive tuning. The underling concepts of the SPOT approach are explained.
This includes key techniques such as exploratory fitness landscape analysis and
response surface methodology. Many examples illustrate how SPOT can be used for
understanding the performance of algorithms and gaining insight into
algorithm’s behavior. Furthermore, we demonstrate how SPOT can be used as an
optimizer and how a sophisticated ensemble approach is able to combine several
meta models via stacking.
We proudly present the first result of our cooperation in the UTOPIAE network:
Lorenzo Gentile, Martin Zaefferer, and Thomas Bartz-Beielstein published a paper about sequential parameter optimization. The paper is based on the talk given by Thomas Bartz-Beielstein during the UTOPIAE Network Training School at University of Strathclyde, Glasgow, earlier this year.
The paper is entitled “In a Nutshell: Sequential Parameter Optimization”. It gives a short introduction to surrogate model based optimization, which will be applied in the UTOPIAE project. Many examples illustrate the usefulness of the SPOT approach.
The paper can be downloaded here.
The abstract reads as follows:
The performance of optimization algorithms relies crucially on their parameterizations. Finding good parameter settings is called algorithm tuning. Using a simple simulated annealing algorithm, we will demonstrate how optimization algorithms can be tuned using the sequential parameter opti- mization toolbox (SPOT). SPOT provides several tools for automated and interactive tuning. The underling concepts of the SPOT approach are explained. This includes key techniques such as exploratory fitness landscape analysis and response surface methodology. Many examples illustrate how SPOT can be used for understanding the performance of algorithms and gaining insight into algorithm’s behavior. Furthermore, we demonstrate how SPOT can be used as an optimizer and how a sophisticated ensemble approach is able to combine several meta models via stacking.
Version 2.0.2 of SPOT, the Sequential Parameter Optimization Toolbox, is available on CRAN:
SPOT provides a set of tools for model based optimization and tuning of algorithms. It includes surrogate models, optimizers and design of experiment approaches. The main interface is spot, which uses sequentially updated surrogate models for the purpose of efficient optimization. The main goal is to ease the burden of objective function evaluations, when a single evaluation requires a significant amount of resources.
Version 2 of the SPOT package is a complete redesign and rewrite of the original R package. Most function interfaces were redesigned to give a more streamlined usage experience. At the same time, modular and transparent code structures allow for increased extensibility. In addition, some new developments were added to the SPOT package. A Kriging model implementation, based on earlier Matlab code by Forrester et al. (Forrester, Sobester, and Keane 2008), has been extended to allow for the usage of categorical inputs. Additionally, it is now possible to use stacking for the construction of ensemble learners (Bartz-Beielstein and Zaefferer 2017). This allows for the creation of models with a far higher predictive performance, by combining the strengths of different modeling approaches.
- Bartz-Beielstein, Thomas, and Martin Zaefferer. 2017. “Model-Based Methods for Continuous and Discrete Global Optimization.” Applied Soft Computing 55: 154–67. doi:10.1016/j.asoc.2017.01.039.
A pre-print is available here: T. Bartz-Beielstein and M. Zaefferer, “Model-based methods for continuous and discrete global optimization,” Fakultät für Informatik und Ingenieurwissenschaften (F10), TH Köln, Schriftenreihe CIplus 8/2016, 2016.
- Bartz-Beielstein, Thomas, Christian Lasarczyk, and Mike Preuss. 2005. “Sequential Parameter Optimization.” In Proceedings Congress on Evolutionary Computation 2005 (Cec’05), 1553. Edinburgh, Scotland. http://www.spotseven.de/wp-content/papercite-data/pdf/blp05.pdf.
- Forrester, Alexander, Andras Sobester, and Andy Keane. 2008. Engineering Design via Surrogate Modelling. Wiley.
During useR!, the international R user conference, Sebastian Krey talked about the “Revised Sequential Parameter Optimization Toolbox”.
Unter der Überschrift “Gummersbacher Professor trainierte Doktoranden an der weltberühmten Pariser Universität Sorbonne” berichtet die TH Köln auf ihrer Webseite über das von Prof. Bartz-Beielstein veranstaltete Training. Der Bericht ist hier zu finden.
Prof. Bartz-Beielstein was invited as a COST Action trainer to give a lecture at Sorbonne Universités – Université Pierre et Marie Curie (UPMC).
The COST Action CA15140 “Improving Applicability of Nature-Inspired Optimisation by Joining Theory and Practice (ImAppNIO)” organized a training school on the theme of the COST Action: bridging the gap between theory and practice and making nature-inspired search and optimization heuristics (like for example evolutionary algorithms) more applicable. Continue reading
The article “Metamodel-based optimization of hot rolling processes in the metal industry” is published in The International Journal of Advanced Manufacturing. As part of the Springer Nature SharedIt initiative, a publicly full-text view-only version of this paper is available here.
The abstract reads as follows: Continue reading
Here is the link to this year’s useR! talk about Sequential Parameter Optimization presented by Sebastian Krey:
The Revised Sequential Parameter Optimization Toolbox
Last week the useR! 2017 conference took place in Brussels, Belgium. The annual useR! conference is the main meeting of the international R user and developer community. Over 1000 participants came to listen to a broad spectrum of talks ranging from technical and R-related computing issues to general statistical topics of current interest .
Here you find some impressions from the conference: Pictures
The SPOTSeven team gave two presentations:
Here you can find the slides:
The talks enjoyed great participation and resulted in lots of interesting discussions afterwards.