Stochastic performance tuning of complex simulation applications using unsupervised machine learning

Machine learning for complex multi-objective problems (MOP) can substantially speedup the discovery of solutions belonging to Pareto landscapes and improve Pareto front accuracy. Studying convergence speedup of multi-objective search on well-known benchmarks is an important step in the development of algorithms to optimize complex problems such as High Energy Physics particle transport simulations. In this paper we will describe how we perform this optimization via a tuning based on genetic algorithms and machine learning for MOP. One of the approaches described is based on the introduction of a specific multivariate analysis operator that can be used in case of expensive fitness function evaluations, in order to speed-up the convergence of the “black-box” optimization problem.

[1]  Jonathan E. Rowe Genetic algorithm theory , 2011, GECCO.

[2]  Paul Honeine,et al.  An eigenanalysis of data centering in machine learning , 2014, ArXiv.

[3]  Marco Laumanns,et al.  Scalable test problems for evolutionary multi-objective optimization , 2001 .

[4]  Stephen R. Marsland,et al.  Convergence Properties of (μ + λ) Evolutionary Algorithms , 2011, AAAI.

[5]  Rene Brun,et al.  Towards a high performance geometry library for particle-detector simulations , 2015 .

[6]  I. Jolliffe,et al.  ON RELATIONSHIPS BETWEEN UNCENTRED AND COLUMN-CENTRED PRINCIPAL COMPONENT ANALYSIS , 2009 .

[7]  Ph Canal,et al.  The GeantV project: preparing the future of simulation , 2015 .

[8]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[9]  Kalyanmoy Deb,et al.  U-NSGA-III : A Unified Evolutionary Algorithm for Single , Multiple , and Many-Objective Optimization , 2014 .

[10]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[11]  Franz Rothlauf,et al.  On the importance of the second largest eigenvalue on the convergence rate of genetic algorithms , 2001 .

[12]  K. Baker,et al.  Singular Value Decomposition Tutorial , 2013 .

[13]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[14]  Michael D. Vose,et al.  The simple genetic algorithm - foundations and theory , 1999, Complex adaptive systems.

[15]  Federico Carminati,et al.  Adaptive track scheduling to optimize concurrency and vectorization in GeantV , 2015 .

[16]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[17]  Anne Auger,et al.  COCO: a platform for comparing continuous optimizers in a black-box setting , 2016, Optim. Methods Softw..