Convergence analysis of a global optimization algorithm using stochastic differential equations

We establish the convergence of a stochastic global optimization algorithm for general non-convex, smooth functions. The algorithm follows the trajectory of an appropriately defined stochastic differential equation (SDE). In order to achieve feasibility of the trajectory we introduce information from the Lagrange multipliers into the SDE. The analysis is performed in two steps. We first give a characterization of a probability measure (Π) that is defined on the set of global minima of the problem. We then study the transition density associated with the augmented diffusion process and show that its weak limit is given by Π.

[1]  Dietmar Maringer,et al.  Global optimization of higher order moments in portfolio selection , 2009, J. Glob. Optim..

[2]  C. Hwang,et al.  Diffusion for global optimization in R n , 1987 .

[3]  Bernt Øksendal,et al.  Stochastic differential equations (3rd ed.): an introduction with applications , 1992 .

[4]  Berç Rustem,et al.  Linearly Constrained Global Optimization and Stochastic Differential Equations , 2006, J. Glob. Optim..

[5]  C. Hwang.  Laplace's Method Revisited: Weak Convergence of Probability Measures , 1980 .

[6]  F. Aluffi-Pentini,et al.  Global optimization and stochastic differential equations , 1985 .

[7]  D. Luenberger.  The Gradient Projection Method Along Geodesics , 1972 .

[8]  Liqun Qi,et al.  A Gradient-based Continuous Method for Large-scale Optimization Problems , 2005, J. Glob. Optim..

[9]  Basilis Gidas,et al.  The Langevin Equation as a Global Minimization Algorithm , 1986 .

[10]  Basilis Gidas,et al.  Simulations and Global Optimization , 1987 .

[11]  Stuart GEMANf.  DIFFUSIONS FOR GLOBAL OPTIMIZATION , 2022 .

[12]  S. Mitter,et al.  Recursive stochastic algorithms for global optimization in R d , 1991 .

[13]  Maria Cristina Recchioni,et al.  A Stochastic Algorithm for Constrained Global Optimization , 2000, J. Glob. Optim..

[14]  S. Orszag,et al.  Advanced mathematical methods for scientists and engineers I: asymptotic methods and perturbation theory. , 1999 .

[15]  S. Geman,et al.  Diffusions for global optimizations , 1986 .

[16]  H. Kushner.  Asymptotic global behavior for stochastic approximation and diffusions with slowly decreasing noise effects: Global minimization via Monte Carlo , 1987 .

[17]  Berç Rustem,et al.  Global optimization of robust chance constrained problems , 2009, J. Glob. Optim..

[18]  Francesco Zirilli,et al.  A global optimization algorithm using stochastic differential equations , 1988, TOMS.