Linearly Constrained Global Optimization and Stochastic Differential Equations

A stochastic algorithm is proposed for the global optimization of nonconvex functions subject to linear constraints. Our method follows the trajectory of an appropriately defined Stochastic Differential Equation (SDE). The feasible set is assumed to be comprised of linear equality constraints, and possibly box constraints. Feasibility of the trajectory is achieved by projecting its dynamics onto the set defined by the linear equality constraints. A barrier term is used for the purpose of forcing the trajectory to stay within the box constraints. Using Laplace’s method we give a characterization of a probability measure (Π) that is defined on the set of global minima of the problem. We then study the transition density associated with the projected diffusion process and show that its weak limit is given by Π. Numerical experiments using standard test problems from the literature are reported. Our results suggest that the method is robust and applicable to large-scale problems.

[1]  G. M.,et al.  Partial Differential Equations I , 2023, Applied Mathematical Sciences.

[2]  Panos M. Pardalos,et al.  A Collection of Test Problems for Constrained Global Optimization Algorithms , 1990, Lecture Notes in Computer Science.

[3]  Liqun Qi,et al.  A Gradient-based Continuous Method for Large-scale Optimization Problems , 2005, J. Glob. Optim..

[4]  Basilis Gidas,et al.  The Langevin Equation as a Global Minimization Algorithm , 1986 .

[5]  H. Kushner Asymptotic global behavior for stochastic approximation and diffusions with slowly decreasing noise effects: Global minimization via Monte Carlo , 1987 .

[6]  Steven A. Orszag,et al.  Asymptotic methods and perturbation theory , 1999 .

[7]  S. Mitter,et al.  Recursive stochastic algorithms for global optimization in R d , 1991 .

[8]  János D. Pintér,et al.  Global Optimization: Software, Test Problems, and Applications , 2002 .

[9]  D. Luenberger The Gradient Projection Method Along Geodesics , 1972 .

[10]  Stuart GEMANf DIFFUSIONS FOR GLOBAL OPTIMIZATION , 2022 .

[11]  F. Aluffi-Pentini,et al.  Global optimization and stochastic differential equations , 1985 .

[12]  Berç Rustem,et al.  Global Optimization of the Scenario Generation and Portfolio Selection Problems , 2006, ICCSA.

[13]  C. Hwang,et al.  Diffusion for global optimization in R n , 1987 .

[14]  C. Hwang Laplace's Method Revisited: Weak Convergence of Probability Measures , 1980 .

[15]  Francesco Zirilli,et al.  A global optimization algorithm using stochastic differential equations , 1988, TOMS.

[16]  Basilis Gidas,et al.  Simulations and Global Optimization , 1987 .

[17]  Maria Cristina Recchioni,et al.  A Stochastic Algorithm for Constrained Global Optimization , 2000, J. Glob. Optim..

[18]  S. Orszag,et al.  Advanced mathematical methods for scientists and engineers I: asymptotic methods and perturbation theory. , 1999 .

[19]  S. Geman,et al.  Diffusions for global optimizations , 1986 .

[20]  Rémi Monasson,et al.  Statistical mechanics methods and phase transitions in optimization problems , 2001, Theor. Comput. Sci..

[21]  Weiping Li,et al.  Applied Nonlinear Control , 1991 .

[22]  W. D. Evans,et al.  PARTIAL DIFFERENTIAL EQUATIONS , 1941 .