Adaptive Penalty and Barrier function based on Fuzzy Logic

Optimization method combining Penalty/Barrier and Fuzzy Logic.Progressive penalty functions depending on the degree of constraint violation.Better results comparing to classical approaches. Optimization methods have been used in many areas of knowledge, such as Engineering, Statistics, Chemistry, among others, to solve optimization problems. In many cases it is not possible to use derivative methods, due to the characteristics of the problem to be solved and/or its constraints, for example if the involved functions are non-smooth and/or their derivatives are not know. To solve this type of problems a Java based API has been implemented, which includes only derivative-free optimization methods, and that can be used to solve both constrained and unconstrained problems. For solving constrained problems, the classic Penalty and Barrier functions were included in the API. In this paper a new approach to Penalty and Barrier functions, based on Fuzzy Logic, is proposed. Two penalty functions, that impose a progressive penalization to solutions that violate the constraints, are discussed. The implemented functions impose a low penalization when the violation of the constraints is low and a heavy penalty when the violation is high. Numerical results, obtained using twenty-eight test problems, comparing the proposed Fuzzy Logic based functions to six of the classic Penalty and Barrier functions are presented. Considering the achieved results, it can be concluded that the proposed penalty functions besides being very robust also have a very good performance.

[1]  Humberto Bustince,et al.  Generalization of the weighted voting method using penalty functions constructed via faithful restricted dissimilarity functions , 2013, Eur. J. Oper. Res..

[2]  Mariano Eriz.  Aggregation Functions: A Guide for Practitioners , 2010 .

[3]  Robert J. Vanderbei,et al.  Interior-Point Algorithms, Penalty Methods and Equilibrium Problems , 2006, Comput. Optim. Appl..

[4]  Luís N. Vicente,et al.  A particle swarm pattern search method for bound constrained global optimization , 2007, J. Glob. Optim..

[5]  Frédéric Ros,et al.  An efficient hybrid genetic algorithm to design finite impulse response filters , 2014, Expert Syst. Appl..

[6]  João Matias,et al.  Indoor Location Using Fingerprinting and Fuzzy Logic , 2011, Eurofuse.

[7]  Sven Leyffer,et al.  Nonlinear programming without a penalty function , 2002, Math. Program..

[8]  K. Wright,et al.  Parallel treatment of block-bidiagonal matrices in the solution of ordinary differential boundary value problems , 1993 .

[9]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[10]  Masao Fukushima,et al.  Tabu Search directed by direct search methods for nonlinear global optimization , 2006, Eur. J. Oper. Res..

[11]  João Matias,et al.  Calibration Procedures for Indoor Location Using Fingerprinting , 2013 .

[12]  João Matias,et al.  Penalty Fuzzy Function for Derivative-Free Optimization , 2011, Eurofuse.

[13]  Charles Audet,et al.  A Pattern Search Filter Method for Nonlinear Programming without Derivatives , 2001, SIAM J. Optim..

[14]  Xinwang Liu,et al.  Some properties of the weighted OWA operator , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Weldon A. Lodwick,et al.  Fuzzy linear programming using a penalty method , 2001, Fuzzy Sets Syst..

[16]  Nicholas I. M. Gould,et al.  CUTE: constrained and unconstrained testing environment , 1995, TOMS.

[17]  Witold Pedrycz,et al.  Superior solution guided particle swarm optimization combined with local search techniques , 2014, Expert Syst. Appl..

[18]  Jan S. Hesthaven,et al.  Stable multi-domain spectral penalty methods for fractional partial differential equations , 2014, J. Comput. Phys..

[19]  Anurag Jayswal,et al.  An Exact l1 Exponential Penalty Function Method for Multiobjective Optimization Problems with Exponential-Type Invexity , 2014 .

[20]  Ronald R. Yager,et al.  Applications and Extensions of OWA Aggregations , 1992, Int. J. Man Mach. Stud..

[21]  J. Kacprzyk,et al.  The Ordered Weighted Averaging Operators: Theory and Applications , 1997 .

[22]  V. Torczon,et al.  Direct search methods: then and now , 2000 .

[23]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[24]  V. Karelin,et al.  Exact penalty methods for nonsmooth optimization , 2014, 2014 20th International Workshop on Beam Dynamics and Optimization (BDO).

[25]  Nicholas I. M. Gould,et al.  An Interior-Point l 1 -Penalty Method for Nonlinear Optimization , 2010 .

[26]  Jorge Nocedal,et al.  Interior Methods for Mathematical Programs with Complementarity Constraints , 2006, SIAM J. Optim..

[27]  A. Sartenaer,et al.  Automatic decrease of the penalty parameter in exact penalty function methods , 1995 .

[28]  Abdelmalik Taleb-Ahmed,et al.  Multi-objective GA optimization of fuzzy penalty for image reconstruction from projections in X-ray tomography , 2012, Digit. Signal Process..

[29]  Chuntian Wang.  Local Existence of Strong Solutions to the 3D Zakharov-Kuznetsov Equation in a Bounded Domain , 2013 .

[30]  Walter Murray,et al.  A barrier algorithm for large nonlinear optimization problems , 2003 .

[31]  Zhipeng Liu,et al.  An Insensitivity Fuzzy C-means Clustering Algorithm Based on Penalty Factor , 2013, J. Softw..

[32]  João Matias,et al.  Direct-Search Penalty/Barrier Methods , 2010, WCE 2010.

[33]  A. Ismael F. Vaz,et al.  An MPCC approach on a Stackelberg game in an electric power market: changing the leadership , 2009, Int. J. Comput. Math..

[34]  M. Teresa T. Monteiro,et al.  Solving Mathematical Programs with Complementarity Constraints with Nonlinear Solvers , 2006 .

[35]  Ting Kei Pong,et al.  Exact Penalty Methods for Non-Lipschitz Optimization , 2014 .

[36]  Masao Fukushima,et al.  Hybrid simulated annealing and direct search method for nonlinear unconstrained global optimization , 2002, Optim. Methods Softw..

[37]  Jorge Nocedal,et al.  Steering exact penalty methods for nonlinear programming , 2008, Optim. Methods Softw..

[38]  Tamara G. Kolda,et al.  Optimization by Direct Search: New Perspectives on Some Classical and Modern Methods , 2003, SIAM Rev..

[39]  Milan Stanojević,et al.  PENALTY METHOD FOR FUZZY LINEAR PROGRAMMING WITH TRAPEZOIDAL NUMBERS , 2009 .

[40]  Katya Scheinberg,et al.  Introduction to derivative-free optimization , 2010, Math. Comput..

[41]  Nikolaos V. Sahinidis,et al.  Derivative-free optimization: a review of algorithms and comparison of software implementations , 2013, J. Glob. Optim..

[42]  João Matias,et al.  Direct Search Optimization Application Programming Interface with Remote Access , 2010 .

[43]  Diethard Klatte,et al.  Constrained Minima and Lipschitzian Penalties in Metric Spaces , 2002, SIAM J. Optim..

[44]  Luís N. Vicente,et al.  PSwarm: a hybrid solver for linearly constrained global derivative-free optimization , 2009, Optim. Methods Softw..

[45]  Ya-Xiang Yuan,et al.  An augmented Lagrangian trust region method for equality constrained optimization , 2015, Optim. Methods Softw..

[46]  Donald Goldfarb,et al.  l2-PENALTY METHODS FOR NONLINEAR PROGRAMMING WITH STRONG GLOBAL CONVERGENCE PROPERTIES , 2004 .

[47]  Alexander J. Zaslavski.  A Sufficient Condition for Exact Penalty in Constrained Optimization , 2005, SIAM J. Optim..