Neural Networks for Modeling and Control of Particle Accelerators

Particle accelerators are host to myriad nonlinear and complex physical phenomena. They often involve a multitude of interacting systems, are subject to tight performance demands, and should be able to run for extended periods of time with minimal interruptions. Often times, traditional control techniques cannot fully meet these requirements. One promising avenue is to introduce machine learning and sophisticated control techniques inspired by artificial intelligence, particularly in light of recent theoretical and practical advances in these fields. Within machine learning and artificial intelligence, neural networks are particularly well-suited to modeling, control, and diagnostic analysis of complex, nonlinear, and time-varying systems, as well as systems with large parameter spaces. Consequently, the use of neural network-based modeling and control techniques could be of significant benefit to particle accelerators. For the same reasons, particle accelerators are also ideal test-beds for these techniques. Many early attempts to apply neural networks to particle accelerators yielded mixed results due to the relative immaturity of the technology for such tasks. The purpose of this paper is to re-introduce neural networks to the particle accelerator community and report on some work in neural network control that is being conducted as part of a dedicated collaboration between Fermilab and Colorado State University (CSU). We describe some of the challenges of particle accelerator control, highlight recent advances in neural network techniques, discuss some promising avenues for incorporating neural networks into particle accelerator control systems, and describe a neural network-based control system that is being developed for resonance control of an RF electron gun at the Fermilab Accelerator Science and Technology (FAST) facility, including initial experimental results from a benchmark controller.

[1]  D. P. Weygand,et al.  Artificial intelligence and accelerator control , 1987 .

[2]  P. Hartmann,et al.  ELECTRON TRANSPORT LINE OPTIMIZATION USING NEURAL NETWORKS AND GENETIC ALGORITHMS , 2006 .

[3]  Ching-Chih Tsai,et al.  Generalized predictive control using recurrent fuzzy neural networks for industrial processes , 2007 .

[4]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[5]  P. Vega,et al.  Neural predictive control. Application to a highly non-linear system , 1999 .

[6]  M. Shirakata,et al.  NUMERICAL METHODS FOR THE ORBIT CONTROL AT THE KEK 12 GEV-PS , 2004 .

[7]  G. P. Liu,et al.  Nonlinear Identification and Control: A Neural Network Approach [Book Review] , 2002, IEEE Control Systems.

[8]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[9]  Gérard Dreyfus,et al.  Neural networks - methodology and applications , 2005 .

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  George F. Luger,et al.  An Intelligent Control Architecture for Accelerator Beamline Tuning , 1997, AAAI/IAAI.

[12]  W. C. Mead,et al.  Optimization and control of a small-angle negative ion source using an on-line adaptive controller based on the connectionist normalized local spline neural network , 1992 .

[13]  Aharon Friedman,et al.  Neural network technique for orbit correction in accelerators/storage rings , 1994 .

[14]  Luigi Fortuna,et al.  CNN-based real-time video detection of plasma instability in nuclear fusion applications , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[15]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[16]  Alexander Scheinker,et al.  Model-independent particle accelerator tuning , 2013 .

[17]  Jinhyuk Choi,et al.  Simulation of the Global Orbit Feedback System for Pohang Light Source , 2000 .

[18]  Niels Kjølstad Poulsen,et al.  Neural Networks for Modelling and Control of Dynamic Systems: A Practitioner’s Handbook , 2000 .

[19]  Alexander Scheinker Extremum Seeking for stabilization , 2012 .

[20]  P. Baldi,et al.  Searching for exotic particles in high-energy physics with deep learning , 2014, Nature Communications.

[21]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[22]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[23]  Hannu T. Toivonen,et al.  Neural network approximation of a nonlinear model predictive controller applied to a pH neutralization process , 2005, Comput. Chem. Eng..

[24]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[25]  Shimon Whiteson,et al.  Evolutionary Computation for Reinforcement Learning , 2012, Reinforcement Learning.

[26]  Paul J. Webros A menu of designs for reinforcement learning over time , 1990 .

[27]  Minwoo Lee,et al.  Faster reinforcement learning after pretraining deep networks to predict state dynamics , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[28]  J. A. Howell,et al.  Control of a negative-ion accelerator source using neural networks , 1990 .

[29]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[30]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[31]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[32]  Thomas Nowotny,et al.  Comparing Neuromorphic Solutions in Action: Implementing a Bio-Inspired Solution to a Benchmark Classification Task on Three Parallel-Computing Platforms , 2019 .

[33]  Paul Skarek,et al.  Multi-agent cooperation for particle accelerator control , 1996 .

[34]  Yi Cao,et al.  Nonlinear system identification for predictive control using continuous time recurrent neural networks and automatic differentiation , 2008 .

[35]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[36]  Emile Fiesler,et al.  Hybrid neural networks and their application to particle accelerator control , 1999, Optics + Photonics.

[37]  P. Bhat Multivariate Analysis Methods in Particle Physics , 2011 .

[38]  Juhao Wu,et al.  An algorithm for online optimization of accelerators , 2013 .

[39]  A. Marchionni,et al.  Proposal for an Accelerator R&D User Facility at Fermilab's Advanced Superconducting Test Accelerator (ASTA) , 2013 .

[40]  Sebastian Engell,et al.  Model Predictive Control Using Neural Networks [25 Years Ago] , 1995, IEEE Control Systems.

[41]  George F. Luger,et al.  Developing a general purpose intelligent control system for particle accelerators , 1999, J. Intell. Fuzzy Syst..

[42]  Hannu T. Toivonen,et al.  A neural network model predictive controller , 2006 .

[43]  W. C. Mead,et al.  Adaptive optimization and control using neural networks , 1994 .

[44]  Sandra Biedron,et al.  Development of a combined feed forward-feedback system for an electron Linac , 2009 .

[45]  X. Pang,et al.  GPU accelerated online multi-particle beam dynamics simulator for ion linear particle accelerators , 2014, Comput. Phys. Commun..

[46]  Xiaobiao Huang,et al.  Online optimization of storage ring nonlinear beam dynamics , 2015, 1502.07799.

[47]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[48]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[49]  Luigi Fortuna,et al.  On the identification of instabilities with neural networks on JET , 2013 .

[50]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[51]  Baoming Ge,et al.  Self-tuning PID Temperature Controller Based on Flexible Neural Network , 2007, ISNN.

[52]  Xiaobiao Huang,et al.  Nonlinear dynamics optimization with particle swarm and genetic algorithms for SPEAR3 emittance upgrade , 2014 .

[53]  Mauro Brunato,et al.  Reactive Search Optimization: Learning While Optimizing , 2018, Handbook of Metaheuristics.

[54]  Jürgen Schmidhuber,et al.  Learning to Forget: Continual Prediction with LSTM , 2000, Neural Computation.

[55]  Alexander Scheinker,et al.  Adaptive method for electron bunch profile prediction , 2015 .

[56]  Lars Grne,et al.  Nonlinear Model Predictive Control: Theory and Algorithms , 2011 .

[57]  L. Biegler,et al.  Quadratic programming methods for reduced Hessian SQP , 1994 .

[58]  Miroslav Krstic,et al.  Minimum-Seeking for CLFs: Universal Semiglobally Stabilizing Feedback Under Unknown Control Directions , 2013, IEEE Transactions on Automatic Control.

[59]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[60]  R. Hedjar ADAPTIVE NEURAL NETWORK MODEL PREDICTIVE CONTROL , 2012 .

[61]  Alex Graves,et al.  Connectionist Temporal Classification , 2012 .

[62]  P. V. Varde,et al.  A multi-agent based control scheme for accelerator pre-injector and transport line for enhancement of accelerator operations , 2012 .

[63]  Ilya Sutskever,et al.  Learning Recurrent Neural Networks with Hessian-Free Optimization , 2011, ICML.

[64]  Berin Martini,et al.  Large-Scale FPGA-based Convolutional Networks , 2011 .

[65]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[66]  Amir Mosavi,et al.  Reactive Search Optimization; Application to Multiobjective Optimization Problems , 2012 .

[67]  Qian Li,et al.  Optimization of injection molding process parameters using combination of artificial neural network and genetic algorithm method , 2007 .

[68]  J. Safranek,et al.  MACHINE BASED OPTIMIZATION USING GENETIC ALGORITHMS IN A STORAGE RING , 2014 .

[69]  Cliff T. Ragsdale,et al.  Combining a neural network with a genetic algorithm for process parameter optimization , 2000 .

[70]  Shuzhi Sam Ge,et al.  Robust Adaptive Neural Network Control for a Class of Uncertain MIMO Nonlinear Systems With Input Nonlinearities , 2010, IEEE Transactions on Neural Networks.

[71]  Jet Efda Contributors,et al.  Development of an efficient real-time disruption predictor from scratch on JET and implications for ITER , 2013 .

[72]  Shuzhi Sam Ge,et al.  Nonlinear identi cation and control — a neural network approach , 2022 .

[73]  P. V. Varde,et al.  Model-based tracking for agent-based control systems in the case of sensor failures , 2012, Int. J. Autom. Comput..

[74]  Jürgen Schmidhuber,et al.  Kalman filters improve LSTM network performance in problems unsolvable by traditional recurrent nets , 2003, Neural Networks.

[75]  L. Grüne,et al.  Nonlinear Model Predictive Control : Theory and Algorithms. 2nd Edition , 2011 .

[76]  F. Perriollat,et al.  Using Archon - 3. Particle acceleration control , 1996, IEEE Expert.

[77]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[78]  P. Lakshmi,et al.  Adaptive neuro-fuzzy controller for non-linear chemical mixing process , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[79]  O. Meneghini,et al.  Modeling of transport phenomena in tokamak plasmas with neural networks , 2014 .

[80]  W. Klein,et al.  Tuning and optimization at Brookhaven and Argonne: results of recent experiments , 1997, Proceedings of the 1997 Particle Accelerator Conference (Cat. No.97CH36167).

[81]  Peter J. Gawthrop,et al.  Neural Networks for Modelling and Control , 1997 .

[82]  Paluri S. V. Nataraj,et al.  Intelligent Agent Based Operator Support and Beam Orbit Control Scheme for Synchrotron Radiation Sources , 2013 .

[83]  Shimon Whiteson,et al.  Machine learning for event selection in high energy physics , 2009, Eng. Appl. Artif. Intell..

[84]  Ching-Chih Tsai,et al.  Adaptive Predictive Control With Recurrent Neural Network for Industrial Processes: An Application to Temperature Control of a Variable-Frequency Oil-Cooling Machine , 2008, IEEE Transactions on Industrial Electronics.

[85]  Zhang Lin,et al.  Global optimization of absorption chiller system by genetic algorithm and neural network , 2002 .

[86]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[87]  Farhan Feroz,et al.  SKYNET: an efficient and robust neural network training tool for machine learning in astronomy , 2013, ArXiv.

[88]  Maciej Lawrynczuk Computationally Efficient Model Predictive Control Algorithms: A Neural Network Approach , 2014 .

[89]  Martin Pieck,et al.  Artificial intelligence research in particle accelerator control systems for beam line tuning , 2008 .

[90]  Julian Togelius,et al.  Evolving Memory Cell Structures for Sequence Learning , 2009, ICANN.

[91]  Maciej Ławryńczuk,et al.  A Family of Model Predictive Control Algorithms With Artificial Neural Networks , 2007, Int. J. Appl. Math. Comput. Sci..

[92]  Mohamed Azlan Hussain,et al.  Review of the applications of neural networks in chemical process control - simulation and online implementation , 1999, Artif. Intell. Eng..

[93]  Jeffrey S. Kolski,et al.  In-hardware demonstration of model-independent adaptive tuning of noisy systems with arbitrary phase drift , 2014 .

[94]  A. Murari,et al.  Identifying JET instabilities with neural networks , 2012, 2012 16th IEEE Mediterranean Electrotechnical Conference.

[95]  Miroslav Krstic,et al.  Extremum Seeking-Based Optimization of High Voltage Converter Modulator Rise-Time , 2014, IEEE Transactions on Control Systems Technology.

[96]  Jinhyuk Choi,et al.  A Simulation Study of the Global Orbit Feedback System for Pohang Light Source. , 2000 .

[97]  P. Torrez,et al.  Gain scheduled neural network tuned pi feedback control system for the lansce accelerator , 2007, 2007 IEEE Particle Accelerator Conference (PAC).

[98]  Kenneth O. Stanley,et al.  Autonomous Evolution of Topographic Regularities in Artificial Neural Networks , 2010, Neural Computation.

[99]  Geoffrey E. Hinton Where Do Features Come From? , 2014, Cogn. Sci..

[100]  Manabu Mizota,et al.  A , Beam Diagnostic System for Accelerator Using Neural Networks , .

[101]  Tao Zhang,et al.  Stable Adaptive Neural Network Control , 2001, The Springer International Series on Asian Studies in Computer and Information Science.

[102]  Carl R. Stern,et al.  Designing a portable architecture for intelligent particle accelerator control , 1997, Proceedings of the 1997 Particle Accelerator Conference (Cat. No.97CH36167).

[103]  Nicholas R. Jennings,et al.  Using Archon to Develop Real-World DAI Applications, Part 1 , 1996, IEEE Expert.

[104]  Hao Huang,et al.  A new zone temperature predictive modeling for energy saving in buildings , 2012 .

[105]  Sandra Biedron,et al.  Development of a novel optimization tool for electron linacs inspired by artificial intelligence techniques in video games , 2011 .

[106]  Maciej Lawrynczuk Nonlinear Predictive Control Based on Multivariable Neural Wiener Models , 2011, ICANNGA.

[107]  Canada.,et al.  Data Mining and Machine Learning in Astronomy , 2009, 0906.2173.

[108]  Abhijit Gosavi,et al.  Reinforcement Learning: A Tutorial Survey and Recent Advances , 2009, INFORMS J. Comput..

[109]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[110]  P. Arena,et al.  First Application of Cellular Nonlinear Network Methods to the Real-Time Identification of Hot Spots in JET , 2009, IEEE Transactions on Plasma Science.

[111]  J. Vega,et al.  Results of the JET real-time disruption predictor in the ITER-like wall campaigns , 2012 .

[112]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[113]  John J. Oh,et al.  Application of machine learning algorithms to the study of noise artifacts in gravitational-wave data , 2013, 1303.6984.

[114]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[115]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[116]  Pamela A. Brown,et al.  The development of an expert system to tune a beam line , 1990 .

[117]  H. Shoaee,et al.  Some applications of AI (Artificial Intelligence) to the problems of accelerator physics , 1986 .

[118]  Shuzhi Sam Ge,et al.  Stable adaptive control and estimation for nonlinear systems - neural and fuzzy approximator techniques: J. T. Spooner, M. Maggiore, R. Ordóñez, K. M. Passino, John Wiley & Sons, Inc., New York, 2002, ISBN: 0-471-41546-4 , 2003, Autom..

[119]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[120]  Geoffrey E. Hinton,et al.  Training Recurrent Neural Networks , 2013 .

[121]  H. Shoaee,et al.  Accelerator and feedback control simulation using neural networks , 1991, Conference Record of the 1991 IEEE Particle Accelerator Conference.

[122]  Sandra Biedron,et al.  Electron beam energy and bunch length feed forward control studies using an artificial neural network at the Linac coherent light source , 2009 .

[123]  A. Murari,et al.  Exploratory Data Analysis Techniques to Determine the Dimensionality of Complex Nonlinear Phenomena: The L-to-H Transition at JET as a Case Study , 2012, IEEE Transactions on Plasma Science.

[124]  Farhan Feroz,et al.  Neural Networks for Astronomical Data Analysis and Bayesian Inference , 2013, 2013 IEEE 13th International Conference on Data Mining Workshops.