Multi-Objective Optimization Methods Based on Artificial Neural Networks

During the last years, several optimization algorithms have been presented and widely investigated in literature, most of which based on deterministic or stochastic methods, in order to solve optimization problems with multiple objectives that conflict with each other. Some multi-objective stochastic optimizers have been developed, based on local or global search methods, in order to solve optimal design problems. Despite the significant progress obtained in this field, there are still many open issues. In fact, both the deterministic and stochastic approaches present hard limits. In the first case, although the number of function evaluations needed to reach the optimal solution is generally small, the risk to be trapped in local minima is very high, whereas in the second case, the probability to reach the optimal solution is higher but the computational cost could become prohibitive. In particular, this is the case of the electromagnetic problems. Electromagnetic devices are fundamental in the modern society. They are used for storing and converting energy (Magele, 1996), manufacturing processes (Takahashi et al., 1996), magnetic resonance imaging (Gottvald et al., 1992), telecommunications, etc. The design optimization of the electromagnetic devices is one key to enhance product quality and manufacturing efficiency. Definition of geometric boundaries to achieve specific design goals together with nonlinear behaviour of ferromagnetic materials often give rise to multimodal, non-linear, and non-derivable objective functions. For this reason, resorting to numerical approaches, such as the Finite Element Method (FEM), to evaluate objective functions in many cases is compulsory. When the number of design parameters to be optimized is considerable, the number of objectives evaluations to be performed could be of the order of thousand and the use of numerical solution during the optimization process can be unfeasible. Approximating techniques have been proposed as a way to overcome the time consuming numerical procedure (Alotto et al., 2001, Canova et al., 2003, Wang & Lowther, 2006). One of the most effective approximation approaches is based on Artificial Neural Networks. In fact, an alternative method to numerical evaluation consists of applying the optimization procedure to the approximation of the objective function, rather than to its numerical model (Abbass, 2003, Fieldsend & Singh, 2005, Carcangiu et al., 2008). On the other hand, the quality of the solution of the optimization problem depends on the error introduced by the approximation

[1]  C. Magele,et al.  Global optimization methods for computational electromagnetics , 1992 .

[2]  E. Salpietro,et al.  Conceptual Design of the 12.5 T Superconducting EFDA Dipole , 2006, IEEE Transactions on Applied Superconductivity.

[3]  Augusto Montisci,et al.  Geometrical synthesis of MLP neural networks , 2008, Neurocomputing.

[4]  David W. Coit,et al.  Multi-objective optimization using genetic algorithms: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[5]  J R Fienup,et al.  Phase retrieval algorithms: a comparison. , 1982, Applied optics.

[6]  Maurizio Repetto,et al.  Magnetic design optimization and objective function approximation , 2003 .

[7]  Jonathan E. Fieldsend,et al.  Pareto evolutionary neural networks , 2005, IEEE Transactions on Neural Networks.

[8]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[9]  A. Fanni,et al.  Multiobjective Tabu Search Algorithms for Optimal Design of Electromagnetic Devices , 2008, IEEE Transactions on Magnetics.

[10]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[11]  Raymond A. Adomaitis,et al.  Noninvertibility in neural networks , 2000 .

[12]  D.A. Lowther,et al.  Selection of approximation models for electromagnetic device optimization , 2006, IEEE Transactions on Magnetics.

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  Jose C. Principe,et al.  Neural and adaptive systems , 2000 .

[15]  Sara Carcangiu,et al.  A constructive algorithm of neural approximation models for optimization problems , 2009 .

[16]  P. Testoni,et al.  Inversion of MLP neural networks for direct solution of inverse problems , 2005, IEEE Transactions on Magnetics.

[17]  Piergiorgio Alotto,et al.  An efficient hybrid algorithm for the optimization of problems with several local minima , 2001 .

[18]  øöö Blockinø Phase retrieval, error reduction algorithm, and Fienup variants: A view from convex optimization , 2002 .

[19]  Hussein A. Abbass,et al.  Pareto neuro-evolution: constructing ensemble of neural networks using multi-objective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[20]  Maria Evelina Mognaschi,et al.  Recent experiences of multiobjective optimisation in electromagnetics , 2005 .

[21]  Robert J. Marks,et al.  Inversion of feedforward neural networks: algorithms and applications , 1999, Proc. IEEE.

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Sara Carcangiu,et al.  Multi Objective Optimization Algorithm Based on Neural Networks Inversion , 2009, IWANN.

[24]  V Elser,et al.  Searching with iterated maps , 2007, Proceedings of the National Academy of Sciences.

[25]  Hajime Kita,et al.  Inverting feedforward neural networks using linear and nonlinear programming , 1999, IEEE Trans. Neural Networks.