A new norm-relaxed method of strongly sub-feasible direction for inequality constrained optimization

Combining the norm-relaxed method of feasible direction (MFD) with the idea of strongly sub-feasible direction method, we present a new convergent algorithm with arbitrary initial point for inequality constrained optimization. At each iteration, the new algorithm solves one direction finding subproblem (DFS) which always possesses a solution. Some good properties of the new algorithm are that it can unify automatically the operations of initialization (Phase I) and optimization (Phase II) and the number of the functions satisfying the inequality constrains is nondecreasing, particularly, a feasible direction of descent can be obtained by solving DFS whenever the iteration point gets into the feasible set. Under some mild assumptions without the linear independence, the global and strong convergence of the algorithm can be obtained.

[1]  Michael M. Kostreva,et al.  A generalization of the norm-relaxed method of feasible directions , 1999, Appl. Math. Comput..

[2]  D. Mayne,et al.  Exact penalty function algorithm with simple updating of the penalty parameter , 1991 .

[3]  M. M. Kostreva,et al.  Global Convergence Analysis of Algorithms for Finding Feasible Points in Norm-Relaxed MFD , 1999 .

[4]  David Q. Mayne,et al.  Combined phase I—phase II methods of feasible directions , 1979, Math. Program..

[5]  E. Polak,et al.  Rate of Convergence of a Class of Methods of Feasible Directions , 1973 .

[6]  Elijah Polak,et al.  On the rate of convergence of certain methods of centers , 1972, Math. Program..

[7]  A. F. Veinott,et al.  On the Convergence of Some Feasible Direction Algorithms for Nonlinear Programming , 1967 .

[8]  Kecun Zhang,et al.  A new SQP method of feasible directions for nonlinear programming , 2004, Appl. Math. Comput..

[9]  H. Kunzi,et al.  Lectu re Notes in Economics and Mathematical Systems , 1975 .

[10]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[11]  G. Zoutendijk,et al.  Methods of Feasible Directions , 1962, The Mathematical Gazette.

[12]  Michael M. Kostreva,et al.  A superlinearly convergent method of feasible directions , 2000, Appl. Math. Comput..

[13]  P. Wolfe On the convergence of gradient methods under constraint , 1972 .

[14]  M. Kostreva,et al.  Norm-relaxed method of feasible directions for solving nonlinear programming problems , 1994 .

[15]  Craig T. Lawrence,et al.  A Computationally Efficient Feasible Sequential Quadratic Programming Algorithm , 2000, SIAM J. Optim..