Global optimization and simulated annealing

In this paper we are concerned with global optimization, which can be defined as the problem of finding points on a bounded subset of ℝn in which some real valued functionf assumes its optimal (maximal or minimal) value.We present a stochastic approach which is based on the simulated annealing algorithm. The approach closely follows the formulation of the simulated annealing algorithm as originally given for discrete optimization problems. The mathematical formulation is extended to continuous optimization problems, and we prove asymptotic convergence to the set of global optima. Furthermore, we discuss an implementation of the algorithm and compare its performance with other well-known algorithms. The performance evaluation is carried out for a standard set of test functions from the literature.

[1]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[2]  A. J. Weir Lebesgue Integration and Measure , 1973 .

[3]  Alexander H. G. Rinnooy Kan,et al.  Stochastic methods for global optimization , 1984 .

[4]  L. E. Scales,et al.  Introduction to Non-Linear Optimization , 1985 .

[5]  G. T. Timmer,et al.  Stochastic global optimization methods part II: Multi level methods , 1987, Math. Program..

[6]  C. Hwang,et al.  Diffusion for global optimization in R n , 1987 .

[7]  Alan J. Mayne,et al.  Towards Global Optimisation 2 , 1976 .

[8]  Stuart GEMANf DIFFUSIONS FOR GLOBAL OPTIMIZATION , 2022 .

[9]  Alexander H. G. Rinnooy Kan,et al.  A stochastic method for global optimization , 1982, Math. Program..

[10]  Steven G. Louie,et al.  A Monte carlo simulated annealing approach to optimization over continuous variables , 1984 .

[11]  G. T. Timmer,et al.  Stochastic global optimization methods part I: Clustering methods , 1987, Math. Program..

[12]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[13]  A. Khachaturyan Statistical mechanics approach in minimizing a multivariable function , 1986 .

[14]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[15]  W. Feller,et al.  An Introduction to Probability Theory and Its Applications, Vol. 1 , 1967 .

[16]  M. E. Johnson,et al.  Generalized simulated annealing for function optimization , 1986 .

[17]  Wyn L. Price,et al.  A Controlled Random Search Procedure for Global Optimisation , 1977, Comput. J..

[18]  F. Aluffi-Pentini,et al.  Global optimization and stochastic differential equations , 1985 .

[19]  S. Geman,et al.  Diffusions for global optimizations , 1986 .

[20]  Ehl Emile Aarts,et al.  Statistical cooling : a general approach to combinatorial optimization problems , 1985 .

[21]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[22]  H. Kushner Asymptotic global behavior for stochastic approximation and diffusions with slowly decreasing noise effects: Global minimization via Monte Carlo , 1987 .

[23]  J. Doob Stochastic processes , 1953 .