Log-Sigmoid Multipliers Method in Constrained Optimization

In this paper we introduced and analyzed the Log-Sigmoid (LS) multipliers method for constrained optimization. The LS method is to the recently developed smoothing technique as augmented Lagrangian to the penalty method or modified barrier to classical barrier methods. At the same time the LS method has some specific properties, which make it substantially different from other nonquadratic augmented Lagrangian techniques.We established convergence of the LS type penalty method under very mild assumptions on the input data and estimated the rate of convergence of the LS multipliers method under the standard second order optimality condition for both exact and nonexact minimization.Some important properties of the dual function and the dual problem, which are based on the LS Lagrangian, were discovered and the primal–dual LS method was introduced.

[1]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[2]  Marc Teboulle,et al.  Nonlinear rescaling and proximal-like methods in convex optimization , 1997, Math. Program..

[3]  Roman A. Polyak,et al.  Modified barrier functions (theory and methods) , 1992, Math. Program..

[4]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[5]  D. Bertsekas,et al.  Multiplier methods for convex programming , 1973, CDC 1973.

[6]  Olvi L. Mangasarian,et al.  Smoothing methods for convex inequalities and linear complementarity problems , 1995, Math. Program..

[7]  Marc Teboulle,et al.  Entropy-Like Proximal Methods in Convex Programming , 1994, Math. Oper. Res..

[8]  J. Sobieszczanski-Sobieski,et al.  The Newton log-sigmoid method in constrained optimization , 1998 .

[9]  Fred Phillips,et al.  Systems and Management Science by Extremal Methods , 1992 .

[10]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[11]  Aaron Melman,et al.  The Newton modified barrier method for QP problems , 1996, Ann. Oper. Res..

[12]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[13]  David F. Shanno,et al.  Preliminary Computational Experience with Modified Log-Barrier Functions for Large-Scale Nonlinear Programming , 1994 .

[14]  David F. Shanno,et al.  Computational experience with penalty-barrier methods for nonlinear programming , 1996, Ann. Oper. Res..

[15]  Marc Teboulle,et al.  On ϕ-Divergence and Its Applications , 1992 .

[16]  Paul Tseng,et al.  On the convergence of the exponential multiplier method for convex programming , 1993, Math. Program..

[17]  Marc Teboulle,et al.  Entropic Proximal Mappings with Applications to Nonlinear Programming , 1992, Math. Oper. Res..

[18]  Michael Zibulevsky,et al.  Penalty/Barrier Multiplier Methods for Convex Programming Problems , 1997, SIAM J. Optim..

[19]  Roberto Cominetti,et al.  Asymptotic Analysis for Penalty and Barrier Methods in Convex and Linear Programming , 1997, Math. Oper. Res..