Solving Nonlinear Equality Constrained Multiobjective Optimization Problems Using Neural Networks

This paper develops a neural network architecture and a new processing method for solving in real time, the nonlinear equality constrained multiobjective optimization problem (NECMOP), where several nonlinear objective functions must be optimized in a conflicting situation. In this processing method, the NECMOP is converted to an equivalent scalar optimization problem (SOP). The SOP is then decomposed into several-separable subproblems processable in parallel and in a reasonable time by multiplexing switched capacitor circuits. The approach which we propose makes use of a decomposition-coordination principle that allows nonlinearity to be treated at a local level and where coordination is achieved through the use of Lagrange multipliers. The modularity and the regularity of the neural networks architecture herein proposed make it suitable for very large scale integration implementation. An application to the resolution of a physical problem is given to show that the approach used here possesses some advantages of the point of algorithmic view, and provides processes of resolution often simpler than the usual techniques.

[1]  A. Namir,et al.  AOSNET: a neural network implementation of adjustable order statistic filters in fixed time , 2000 .

[2]  Mohammed Mestari,et al.  An analog neural network implementation in fixed time of adjustable-order statistic filters and applications , 2004, IEEE Transactions on Neural Networks.

[3]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[4]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[5]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[6]  Timothy X. Brown,et al.  Neural Network Design of a Banyan Network Controller , 1990, IEEE J. Sel. Areas Commun..

[7]  Chang Wook Ahn,et al.  Advances in Evolutionary Algorithms: Theory, Design and Practice , 2006, Studies in Computational Intelligence.

[8]  Zhi-Hong Mao,et al.  Dynamics of Winner-Take-All Competition in Recurrent Neural Networks With Lateral Inhibition , 2007, IEEE Transactions on Neural Networks.

[9]  A. Namir,et al.  A Neural-Network to Solving the Output Contention in Packet Switching Networks , 2009 .

[10]  Manoj Kumar Tiwari,et al.  Interactive Particle Swarm: A Pareto-Adaptive Metaheuristic to Multiobjective Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[11]  Le Nguyen Binh,et al.  A neural-network contention controller for packet switching networks , 1995, IEEE Trans. Neural Networks.

[12]  Yuguang Fang,et al.  Dynamic Analysis of a General Class of Winner-Take-All Competitive Neural Networks , 2010, IEEE Transactions on Neural Networks.

[13]  Kiyoshi Tanaka,et al.  Working principles, behavior, and performance of MOEAs on MNK-landscapes , 2007, Eur. J. Oper. Res..

[14]  Serge Domenech,et al.  Enhanced genetic algorithm-based fuzzy multiobjective strategy to multiproduct batch plant design , 2009, Appl. Soft Comput..

[15]  T.X. Brown,et al.  Neural networks for switching , 1989, IEEE Communications Magazine.

[16]  M. Mestari,et al.  Measurement of inverse temperature gradient along a turbulent plane flame using an optical method , 2004 .

[17]  Fouad Bennis,et al.  A new method for decision making in multi-objective optimization problems , 2012 .

[18]  P. Fleming,et al.  Convergence Acceleration Operator for Multiobjective Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[19]  Haralambos Sarimveis,et al.  A Simulated Annealing Algorithm for Prioritized Multiobjective Optimization—Implementation in an Adaptive Model Predictive Control Configuration , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  Mohammad Ali Abido,et al.  Multiobjective evolutionary algorithms for electric power dispatch problem , 2006, IEEE Transactions on Evolutionary Computation.

[21]  Michael G. Parsons,et al.  Formulation of Multicriterion Design Optimization Problems for Solution With Scalar Numerical Optimization Methods , 2004 .

[22]  G. P. Rangaiah,et al.  Multi-objective optimization of the operation of an industrial low-density polyethylene tubular reactor using genetic algorithm and its jumping gene adaptations , 2006 .

[23]  Manoj Kumar Tiwari,et al.  Multiobjective Particle Swarm Algorithm With Fuzzy Clustering for Electrical Power Dispatch , 2008, IEEE Transactions on Evolutionary Computation.

[24]  Hong Chen,et al.  Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks , 1993, IEEE Trans. Neural Networks.

[25]  Yaser S. Abu-Mostafa,et al.  Analog Neural Networks as Decoders , 1990, NIPS.

[26]  Hong Chen,et al.  Approximation capability in C(R¯n) by multilayer feedforward networks and related problems , 1995, IEEE Trans. Neural Networks.

[27]  Gabriele Eichfelder,et al.  Adaptive Scalarization Methods in Multiobjective Optimization , 2008, Vector Optimization.

[28]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[29]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[30]  Nirupam Chakraborti,et al.  Identification and Optimization of AB2 Phases Using Principal Component Analysis, Evolutionary Neural Nets, and Multiobjective Genetic Algorithms , 2009 .

[31]  A. Namir,et al.  Θ(1) Time Neural Network Minimum Distance Classifier and its Application to Optical Character Recognition Problem , 2008 .

[32]  I. Y. Kim,et al.  Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , 2005 .

[33]  Zhang Yi,et al.  A Winner-Take-All Neural Networks of N Linear Threshold Neurons without Self-Excitatory Connections , 2009, Neural Processing Letters.

[34]  M. Mestari,et al.  Calculation of the diffusion coefficient in a heated turbulent medium using optimisation techniques , 2002 .

[35]  Francisco Herrera,et al.  A Multi-Objective Genetic Algorithm for Tuning and Rule Selection to Obtain Accurate and Compact Linguistic Fuzzy Rule-Based Systems , 2007, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[36]  L. Jain,et al.  Evolutionary multiobjective optimization : theoretical advances and applications , 2005 .