Exact penalty and error bounds in DC programming

In the present paper, we are concerned with conditions ensuring the exact penalty for nonconvex programming. Firstly, we consider problems with concave objective and constraints. Secondly, we establish various results on error bounds for systems of DC inequalities and exact penalty, with/without error bounds, in DC programming. They permit to recast several class of difficult nonconvex programs into suitable DC programs to be tackled by the efficient DCA.

[1]  J. Dedieu.  Penalty functions in subanalytic optimization , 1992 .

[2]  T. P. Dinh,et al.  Convex analysis approach to d.c. programming: Theory, Algorithm and Applications , 1997 .

[3]  Zhi-Quan Luo,et al.  Extension of Hoffman's Error Bound to Polynomial Systems , 1994, SIAM J. Optim..

[4]  Reiner Horst,et al.  Introduction to Global Optimization (Nonconvex Optimization and Its Applications) , 2002 .

[5]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[6]  F. Giannessi.  Variational Analysis and Generalized Differentiation , 2006 .

[7]  Le Thi Hoai An,et al.  DC programming techniques for solving a class of nonlinear bilevel programs , 2009, J. Glob. Optim..

[8]  Olvi L. Mangasarian,et al.  Error bounds for monotone linear complementarity problems , 1986, Math. Program..

[9]  Huynh van Ngai,et al.  Stability of Error Bounds for Convex Constraint Systems in Banach Spaces , 2010, SIAM J. Optim..

[10]  Juan Enrique Martínez-Legaz,et al.  Lower subdifferentiability in minimax fractional programming , 1999 .

[11]  Le Thi Hoai An,et al.  A DC programming approach for feature selection in support vector machines learning , 2008, Adv. Data Anal. Classif..

[12]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[13]  Abderrahim Jourani,et al.  Erratum: Hoffman's Error Bound, Local Controllability, and Sensitivity Analysis , 2000, SIAM J. Control. Optim..

[14]  Alfred Auslender,et al.  Global Regularity Theorems , 1988, Math. Oper. Res..

[15]  Jean-Noël Corvellec,et al.  Characterizations of error bounds for lower semicontinuous functions on metric spaces , 2004 .

[16]  Hoai An Le Thi,et al.  A continuous approch for globally solving linearly constrained quadratic , 2001 .

[17]  Le Thi Hoai An,et al.  An efficient algorithm for globally minimizing a quadratic function under convex quadratic constraints , 2000, Math. Program..

[18]  Huynh van Ngai,et al.  Stability of Error Bounds for Semi-infinite Convex Constraint Systems , 2010, SIAM J. Optim..

[19]  Xi Yin Zheng,et al.  Error Bounds for Lower Semicontinuous Functions in Normed Spaces , 2001, SIAM J. Optim..

[20]  James V. Burke,et al.  A Unified Analysis of Hoffman's Bound via Fenchel Duality , 1996, SIAM J. Optim..

[21]  Huynh van Ngai,et al.  A Fuzzy Necessary Optimality Condition for Non-Lipschitz Optimization in Asplund Spaces , 2002, SIAM J. Optim..

[22]  Le Thi Hoai An,et al.  A method for solving d.c. programming problems. Application to fuel mixture nonconvex optimization problem , 1995, J. Glob. Optim..

[23]  Panos M. Pardalos,et al.  Introduction to Global Optimization , 2000, Introduction to Global Optimization.

[24]  J. Pang,et al.  Global error bounds for convex quadratic inequality systems , 1994 .

[25]  Z. Luo,et al.  Error Bounds for Quadratic Systems , 1999 .

[26]  A. Ioffe.  Regular points of Lipschitz functions , 1979 .

[27]  Hans Frenk,et al.  High performance optimization , 2000 .

[28]  Le Thi Hoai An,et al.  Properties of two DC algorithms in quadratic programming , 2011, J. Glob. Optim..

[29]  Joaquim Júdice,et al.  A DC programming approach for solving the symmetric Eigenvalue Complementarity Problem , 2012, Comput. Optim. Appl..

[30]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[31]  Zhi-Quan Luo,et al.  Exact penalization and stationarity conditions of mathematical programs with equilibrium constraints , 1996, Math. Program..

[32]  R. Horst,et al.  DC Programming: Overview , 1999 .

[33]  J. Hiriart-Urruty,et al.  Convex analysis and minimization algorithms , 1993 .

[34]  Wu Li,et al.  Exact order of Hoffman’s error bounds for elliptic quadratic inequalities derived from vector-valued Chebyshev approximation , 2000, Math. Program..

[35]  Le Thi Hoai An,et al.  An efficient combined DCA and B&B using DC/SDP relaxation for globally solving binary quadratic programs , 2010, J. Glob. Optim..

[36]  A. Kruger,et al.  Error Bounds: Necessary and Sufficient Conditions , 2010 .

[37]  Jane J. Ye,et al.  On error bounds for lower semicontinuous functions , 2002, Math. Program..

[38]  Zhi-Quan Luo,et al.  Error bounds for analytic systems and their applications , 1994, Math. Program..

[39]  René Henrion,et al.  Sufficient Conditions for Error Bounds and Applications , 2004 .

[40]  Le Thi Hoai An,et al.  Optimization based DC programming and DCA for hierarchical clustering , 2007, Eur. J. Oper. Res..

[41]  S. M. Robinson.  An Application of Error Bounds for Convex Programming in a Linear Space , 1975 .

[42]  Le Thi Hoai An,et al.  A Branch and Bound Method via d.c. Optimization Algorithms and Ellipsoidal Technique for Box Constrained Nonconvex Quadratic Problems , 1998, J. Glob. Optim..

[43]  Pascal Bouvry,et al.  A combined DCA: GA for constructing highly nonlinear balanced boolean functions in cryptography , 2010, J. Glob. Optim..

[44]  Huynh van Ngai,et al.  Error bounds for convex differentiable inequality systems in Banach spaces , 2005, Math. Program..

[45]  Le Thi Hoai An,et al.  A DC Programming Approach for Sparse Eigenvalue Problem , 2010, ICML.

[46]  L. Muu,et al.  Simplicially-Constrained DC Optimization over Efficient and Weakly Efficient Sets , 2003 .

[47]  Reiner Horst,et al.  On solving a D.C. programming problem by a sequence of linear programs , 1991, J. Glob. Optim..

[48]  Le Thi Hoai An,et al.  Combining DCA (DC Algorithms) and interior point techniques for large-scale nonconvex quadratic programming , 2008, Optim. Methods Softw..

[49]  S. Łojasiewicz.  Sur le problème de la division , 1959 .

[50]  Jong-Shi Pang,et al.  Error bounds in mathematical programming , 1997, Math. Program..

[51]  Wu Li,et al.  Abadie's Constraint Qualification, Metric Regularity, and Error Bounds for Differentiable Convex Inequalities , 1997, SIAM J. Optim..

[52]  Le Thi Hoai An,et al.  The DC (Difference of Convex Functions) Programming and DCA Revisited with DC Models of Real World Nonconvex Optimization Problems , 2005, Ann. Oper. Res..

[53]  Hoai An Le Thi,et al.  Solving a Class of Linearly Constrained Indefinite Quadratic Problems by D.C. Algorithms , 1997 .

[54]  Le Thi Hoai An,et al.  Large-Scale Molecular Optimization from Distance Matrices by a D.C. Optimization Approach , 2003, SIAM J. Optim..

[55]  D. Azé,et al.  A survey on error bounds for lower semicontinuous functions , 2003 .

[56]  A. Lewis,et al.  Error Bounds for Convex Inequality Systems , 1998 .

[57]  J. Burke.  An exact penalization viewpoint of constrained optimization , 1991 .

[58]  R. Hoprst,et al.  Deterministic global optimization with partition sets whose feasibility is not known: Application to concave minimization, reverse convex constraints, DC-programming, and Lipschitzian optimization , 1988 .

[59]  Wu Li,et al.  Asymptotic constraint qualifications and global error bounds for convex inequalities , 1999, Math. Program..

[60]  W. Gander,et al.  A D.C. OPTIMIZATION ALGORITHM FOR SOLVING THE TRUST-REGION SUBPROBLEM∗ , 1998 .

[61]  Le Thi Hoai An,et al.  A continuous approach for the concave cost supply problem via DC programming and DCA , 2008, Discret. Appl. Math..

[62]  Huynh Van Ngai.  On Necessary Conditions for Nonlipschitz Optimization Problems , 2000 .

[63]  Tao Pham Dinh,et al.  An efficient DC programming approach for portfolio decision with higher moments , 2011, Comput. Optim. Appl..

[64]  Olvi L. Mangasarian,et al.  A Condition Number for Differentiable Convex Inequalities , 1985, Math. Oper. Res..

[65]  H. Tuy.  Convex analysis and global optimization , 1998 .

[66]  A. Hoffman.  On approximate solutions of systems of linear inequalities , 1952 .

[67]  Huynh van Ngai,et al.  Error Bounds in Metric Spaces and Application to the Perturbation Stability of Metric Regularity , 2008, SIAM J. Optim..

[68]  Le Thi Hoai An,et al.  A D.C. Optimization Algorithm for Solving the Trust-Region Subproblem , 1998, SIAM J. Optim..

[69]  Huynh van Ngai,et al.  Error bounds for systems of lower semicontinuous functions in Asplund spaces , 2008, Math. Program..

[70]  Michel Théra,et al.  Error Bounds and Implicit Multifunction Theorem in Smooth Banach Spaces and Applications to Optimization , 2004 .

[71]  Jean-Paul Penot,et al.  Generalized Convexity and Generalized Monotonicity , 2001 .

[72]  O. Cornejo,et al.  Conditioning and Upper-Lipschitz Inverse Subdifferentials in Nonsmooth Optimization Problems , 1997 .