Random tunneling by means of acceptance-rejection sampling for global optimization

Any global minimization algorithm is made by several local searches performed sequentially. In the classical multistart algorithm, the starting point for each new local search is selected at random uniformly in the region of interest. In the tunneling algorithm, such a starting point is required to have the same function value obtained by the last local minimization. We introduce the class of acceptance-rejection based algorithms in order to investigate intermediate procedures. A particular instance is to choose at random the new point approximately according to a Boltzmann distribution, whose temperatureT is updated during the algorithm. AsT → 0, such distribution peaks around the global minima of the cost function, producing a kind of random tunneling effect. The motivation for such an approach comes from recent works on the simulated annealing approach in global optimization. The resulting algorithm has been tested on several examples proposed in the literature.

[1]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[2]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[3]  V. M. Glushkov,et al.  Automata theory and formal microprogram transformations , 1965 .

[4]  Martin Pincus,et al.  Letter to the Editor - -A Closed Form Solution of Certain Programming Problems , 1968, Oper. Res..

[5]  J. K. Hartman Some experiments in global optimization , 1973 .

[6]  Luc Devroye,et al.  Progressive global random search of continuous functions , 1978, Math. Program..

[7]  C. Hwang Laplace's Method Revisited: Weak Convergence of Probability Measures , 1980 .

[8]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo Method , 1981 .

[9]  Roger J.-B. Wets,et al.  Minimization by Random Search Techniques , 1981, Math. Oper. Res..

[10]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  B. Betrò Bayesian testing of nonparametric hypotheses and its application to global optimization , 1984 .

[13]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  F. Aluffi-Pentini,et al.  Global optimization and stochastic differential equations , 1985 .

[15]  A. V. Levy,et al.  The Tunneling Algorithm for the Global Minimization of Functions , 1985 .

[16]  Bruce Hajek,et al.  A tutorial survey of theory and applications of simulated annealing , 1985, 1985 24th IEEE Conference on Decision and Control.

[17]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[18]  L. Grippo,et al.  An exact penalty function method with global convergence properties for nonlinear programming problems , 1986, Math. Program..

[19]  Alexander H. G. Rinnooy Kan,et al.  Bayesian stopping rules for multistart global optimization methods , 1987, Math. Program..

[20]  S. Lucidi New results on a class of exact augmented Lagrangians , 1988 .

[21]  Mauro Piccioni,et al.  A combined multistart-annealing algorithm for continuous global optimization , 1991 .