Robust simplex algorithm for online optimization

A new optimization algorithm is introduced for online optimization applications. The algorithm was modified from the popular Nelder-Mead simplex method to make it noise aware and noise resistant. Simulation with an analytic function is used to demonstrate its performance. The algorithm has been successfully tested in experiments, which showed that the algorithm is robust for optimization problems with complex functional dependence, high cross-coupling between parameters, and high noise. Advantages of the new algorithm include high efficiency and that it does not require prior knowledge of the parameter space such as an initial conjugate direction set.

[1]  Juhao Wu,et al.  An algorithm for online optimization of accelerators , 2013 .

[2]  W. Marsden.  I and J , 2012 .

[3]  Xiaobiao Huang,et al.  Online optimization of storage ring nonlinear beam dynamics , 2015, 1502.07799.

[4]  J. Safranek,et al.  Experimental determination of storage ring optics using orbit response measurements , 1997 .

[5]  Lawrence J. Rybarcyk,et al.  Multi-objective particle swarm and genetic algorithm for the optimization of the LANSCE linac operation , 2014 .

[6]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[7]  J. Safranek,et al.  MACHINE BASED OPTIMIZATION USING GENETIC ALGORITHMS IN A STORAGE RING , 2014 .

[8]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[9]  Alexander Scheinker,et al.  Minimization of Betatron Oscillations of Electron Beam Injected Into a Time-Varying Lattice via Extremum Seeking , 2018, IEEE Transactions on Control Systems Technology.

[10]  Feasibility study of online tuning of the luminosity in a circular collider with the robust conjugate direction search method , 2015, 1503.07286.

[11]  Charles Sinclair,et al.  Multivariate optimization of a high brightness dc gun photoinjector , 2005 .

[12]  Kuo-Hao Chang,et al.  Stochastic Nelder-Mead simplex method - A new globally convergent direct search method for simulation optimization , 2012, Eur. J. Oper. Res..

[13]  James R. Wilson,et al.  A revised simplex search procedure for stochastic simulation response-surface optimization , 1998, WSC '98.

[14]  M. J. D. Powell,et al.  An efficient method for finding the minimum of a function of several variables without calculating derivatives , 1964, Comput. J..

[15]  J. S. Ivey,et al.  Nelder-Mead simplex modifications for simulation optimization , 1996 .