Fast, Efficient and Flexible Particle Accelerator Optimisation Using Densely Connected and Invertible Neural Networks

Particle accelerators are enabling tools for scientific exploration and discovery in various disciplines. However, finding optimised operation points for these complex machines is a challenging task due to the large number of parameters involved and the underlying non-linear dynamics. Here, we introduce two families of data-driven surrogate models, based on deep and invertible neural networks, that can replace the expensive physics computer models. These models are employed in multi-objective optimisations to find Pareto optimal operation points for two fundamentally different types of particle accelerators. Our approach reduces the time-to-solution for a multi-objective accelerator optimisation up to a factor of 640 and the computational cost up to 98%. The framework established here should pave the way for future online and real-time multi-objective optimisation of particle accelerators.

[1]  J. J. Yang,et al.  Proposal for an electron antineutrino disappearance search using high-rate 8Li production and decay. , 2012, Physical review letters.

[2]  Andreas Adelmann,et al.  Machine Learning for Orders of Magnitude Speedup in Multi-Objective Optimization of Particle Accelerator Systems. , 2019 .

[3]  Ion Stoica,et al.  Tune: A Research Platform for Distributed Model Selection and Training , 2018, ArXiv.

[4]  R. Lehe,et al.  Bayesian Optimization of a Laser-Plasma Accelerator. , 2021, Physical review letters.

[5]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[6]  Bernhard Schölkopf,et al.  A Kernel Two-Sample Test , 2012, J. Mach. Learn. Res..

[7]  R. Barlow,et al.  Medical isotope production with the IsoDAR cyclotron , 2019, Nature Reviews Physics.

[8]  Matthias Frey,et al.  Matching of turn pattern measurements for cyclotrons using multiobjective optimization , 2019, Physical Review Accelerators and Beams.

[9]  No final frontier , 2019, Nature Reviews Physics.

[10]  Peter Arbenz,et al.  Parallel general purpose multiobjective optimization framework with application to electron beam dynamics , 2019, Physical Review Accelerators and Beams.

[11]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[12]  Peter Arbenz,et al.  Constrained multiobjective shape optimization of superconducting rf cavities considering robustness against geometric perturbations , 2019, Physical Review Accelerators and Beams.

[13]  J. Alonso,et al.  IsoDAR: A cyclotron-based neutrino source with applications to medical isotope production , 2019, 25TH INTERNATIONAL CONFERENCE ON THE APPLICATION OF ACCELERATORS IN RESEARCH AND INDUSTRY.

[14]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[15]  J. J. Yang,et al.  IsoDAR@KamLAND: A Conceptual Design Report for the Technical Facility , 2015, 1511.05130.

[16]  Colwyn Gulliford,et al.  Multiobjective optimization design of an rf gun based electron diffraction beam line , 2017 .

[17]  Charles Sinclair,et al.  Multivariate optimization of a high brightness dc gun photoinjector , 2005 .

[18]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[19]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[20]  V. Shiltsev Particle beams behind physics discoveries , 2020, Physics Today.

[21]  Ullrich Köthe,et al.  Analyzing Inverse Problems with Invertible Neural Networks , 2018, ICLR.

[22]  Alexander Scheinker,et al.  Online multi-objective particle accelerator optimization of the AWAKE electron beam line for simultaneous emittance and orbit control , 2020, 2003.11155.

[23]  A. Adelmann,et al.  OPAL a Versatile Tool for Charged Particle Accelerator Simulations , 2019, 1905.06654.