SPT: a stochastic tunneling algorithm for global optimization

A stochastic approach to solving unconstrained continuous-function global optimization problems is presented. It builds on the tunneling approach to deterministic optimization presented by Barhen and co-workers (Bahren and Protopopescu, in: State of the Art in Global Optimization, Kluwer, 1996; Barhen et al., Floudas and Pardalos (eds.), TRUST: a deterministic algorithm for global optimization, 1997) by combining a series of local descents with stochastic searches. The method uses a rejection-based stochastic procedure to locate new local minima descent regions and a fixed Lipschitz-like constant to reject unpromising regions in the search space, thereby increasing the efficiency of the tunneling process. The algorithm is easily implemented in low-dimensional problems and scales easily to large problems. It is less effective without further heuristics in these latter cases, however. Several improvements to the basic algorithm which make use of approximate estimates of the algorithms parameters for implementation in high-dimensional problems are also discussed. Benchmark results are presented, which show that the algorithm is competitive with the best previously reported global optimization techniques. A successful application of the approach to a large-scale seismology problem of substantial computational complexity using a low-dimensional approximation scheme is also reported.

[1]  P. Pardalos,et al.  State of the art in global optimization: computational methods and applications , 1996 .

[2]  John B. DuBose Practical steps toward realizing the potential of Monte Carlo automatic statics , 1993 .

[3]  Jon G. Rokne,et al.  New computer methods for global optimization , 1988 .

[4]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[5]  Regina Hunter Mladineo An algorithm for finding the global maximum of a multimodal, multivariate function , 1986, Math. Program..

[6]  Reiner Horst,et al.  Introduction to Global Optimization (Nonconvex Optimization and Its Applications) , 2002 .

[7]  Mrinal K. Sen,et al.  Global Optimization Methods in Geophysical Inversion , 1995 .

[8]  Öz Yilmaz,et al.  Seismic data processing , 1987 .

[9]  Jacob Barhen,et al.  TRUST: A deterministic algorithm for global optimization , 1997 .

[10]  David J. Evans,et al.  The Annealing Evolution Algorithm as Function Optimizer , 1995, Parallel Comput..

[11]  C. Stephens,et al.  Global Optimization Requires Global Information , 1998 .

[12]  A. V. Levy,et al.  The Tunneling Algorithm for the Global Minimization of Functions , 1985 .

[13]  S. A. Piyavskii An algorithm for finding the absolute extremum of a function , 1972 .

[14]  P. Pardalos,et al.  Handbook of global optimization , 1995 .

[15]  W. Baritompa,et al.  Customizing methods for global optimization-a geometric viewpoint , 1993, J. Glob. Optim..

[16]  Daniel H. Rothman,et al.  Nonlinear inversion, statistical mechanics, and residual statics estimation , 1985 .

[17]  Yurij G. Evtushenko,et al.  Numerical Optimization Techniques , 1985 .

[18]  Panos M. Pardalos,et al.  Introduction to Global Optimization , 2000, Introduction to Global Optimization.

[19]  Jacek Klinowski,et al.  Taboo Search: An Approach to the Multiple Minima Problem , 1995, Science.

[20]  Graham R. Wood,et al.  The bisection method in higher dimensions , 1992, Math. Program..

[21]  Xin Yao,et al.  Evolutionary Optimization , 2002 .

[22]  F. Aluffi-Pentini,et al.  Global optimization and stochastic differential equations , 1985 .

[23]  Bedri C. Cetin,et al.  Terminal repeller unconstrained subenergy tunneling (trust) for fast global optimization , 1993 .