Two differential equation systems for equality-constrained optimization

Abstract This paper presents two differential systems, involving first and second order derivatives of problem functions, respectively, for solving equality-constrained optimization problems. Local minimizers to the optimization problems are proved to be asymptotically stable equilibrium points of the two differential systems. First, the Euler discrete schemes with constant stepsizes for the two differential systems are presented and their convergence theorems are demonstrated. Second, we construct algorithms in which directions are computed by these two systems and the stepsizes are generated by Armijo line search to solve the original equality-constrained optimization problem. The constructed algorithms and the Runge–Kutta method are employed to solve the Euler discrete schemes and the differential equation systems, respectively. We prove that the discrete scheme based on the differential equation system with the second order information has the locally quadratic convergence rate under the local Lipschitz condition. The numerical results given here show that Runge–Kutta method has better stability and higher precision and the numerical method based on the differential equation system with the second information is faster than the other one.

[1]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[2]  Michael J. Todd,et al.  Least-change quasi-Newton updates for equality-constrained optimization , 2000, Math. Program..

[3]  H. L. Le Roy,et al.  Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability; Vol. IV , 1969 .

[4]  Yurij G. Evtushenko,et al.  Numerical Optimization Techniques , 1985 .

[5]  Z. Liwei Two Differential Systems for Solving Nonlinear Programming Problems , 2000 .

[6]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[7]  Yuri G. Evtushenko,et al.  Stable barrier-projection and barrier-Newton methods in linear programming , 1994, Comput. Optim. Appl..

[8]  Hiroshi Yamashita,et al.  A differential equation approach to nonlinear programming , 1980, Math. Program..

[9]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[10]  Vitali G. Zhadan,et al.  Stable Barrier-Projection and Barrier-Newton Methods for Linear and Nonlinear Programming , 1994 .

[11]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[12]  V. G. Zhadan,et al.  Stable Barrier-projection and Barrier-Newton methods in nonlinear programming , 1994 .

[13]  Philip E. Gill,et al.  Numerical Linear Algebra and Optimization , 1991 .

[14]  Emilio Spedicato,et al.  Algorithms for Continuous Optimization , 1994 .

[15]  J. Dussault,et al.  Stable exponential-penalty algorithm with superlinear convergence , 1994 .

[16]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.