Comparison between multi-objective and single-objective optimization for the modeling of dynamic systems

Modeling input–output data representing a dynamic system is a challenging task when multiple objectives are involved. The developed model needs to be parsimonious yet still adequate. To achieve these goals, two objective functions, i.e. optimum structure and minimum predictive error, need to be satisfied. Most works in system identification only consider one objective function, i.e. minimum predictive error, and the model structure is obtained by trial and error. This paper attempts to establish the needs of a multi-objective optimization algorithm by comparing it with a single-objective optimization algorithm. In this study, two different types of optimization algorithms are used to model a discrete-time system. These are an elitist non-dominated sorting genetic algorithm for multi-objective optimization and a modified genetic algorithm for single-objective optimization. Simulated and real systems data are studied for comparison in terms of model predictive accuracy and model complexity. The results show the advantage of the multi-objective optimization algorithm compared with the single-objective optimization algorithm in developing an adequate and parsimonious model for a discrete-time system.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  F. Naghdy,et al.  Application of genetic algorithms to system identification , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[3]  Sayed Mohammad Reza Loghmanian,et al.  Multi-Objective Optimization of NARX Model for System Identification Using Genetic Algorithm , 2009, 2009 First International Conference on Computational Intelligence, Communication Systems and Networks.

[4]  Lennart Ljung,et al.  Modeling Of Dynamic Systems , 1994 .

[5]  Wei-Der Chang,et al.  Nonlinear system identification and control using a real-coded genetic algorithm , 2007 .

[6]  Y. Ni,et al.  Modelling and identification of a wire-cable vibration isolator via a cyclic loading test , 1999 .

[7]  Peter J. Fleming,et al.  Multiobjective Genetic Programming: A Nonlinear System Identification Application , 1997 .

[8]  Stephen A. Billings,et al.  An adaptive orthogonal search algorithm for model subset selection and non-linear system identification , 2008, Int. J. Control.

[9]  Nitish D. Patel,et al.  Intelligent Structure Selection of Polynomial Nonlinear Systems using Evolutionary Programming , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[10]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[11]  Alina Patelli,et al.  Multiobjective Genetic Programming for Nonlinear System Identification , 2009, ICANNGA.

[12]  S. Billings,et al.  Correlation based model validity tests for non-linear models , 1986 .

[13]  Mohd Azlan Hussain,et al.  Model structure selection for a discrete-time non-linear system using a genetic algorithm , 2004 .

[14]  L. Jain,et al.  Evolutionary multiobjective optimization : theoretical advances and applications , 2005 .

[15]  Shigeru Okuma,et al.  Nonlinear system identification using genetic algorithm , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[16]  Toshiharu Hatanaka,et al.  Nonlinear Dynamic System Identification Based on Multiobjectively Selected RBF Networks , 2007, 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making.

[17]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[18]  G-C Luh,et al.  Non-linear system identification using genetic algorithms , 1999 .

[19]  Gianluca D'Errico,et al.  Multi-objective optimization of internal combustion engine by means of 1D fluid-dynamic models , 2011 .

[20]  R. Saravanan,et al.  Evolutionary multi criteria design optimization of robot grippers , 2009, Appl. Soft Comput..

[21]  Sheng Chen,et al.  Representations of non-linear systems: the NARMAX model , 1989 .

[22]  Stephen A. Billings,et al.  An alternative solution to the model structure selection problem , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[23]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[24]  Carlos M. Fonseca,et al.  'Identifying the structure of nonlinear dynamic systems using multiobjective genetic programming , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[26]  S. Billings,et al.  Orthogonal parameter estimation algorithm for non-linear stochastic systems , 1988 .

[27]  S. Baskar,et al.  Solving multiobjective optimal reactive power dispatch using modified NSGA-II , 2011 .

[28]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[29]  P. Young,et al.  Time series analysis, forecasting and control , 1972, IEEE Transactions on Automatic Control.

[30]  David B. Fogel,et al.  Evolution-ary Computation 1: Basic Algorithms and Operators , 2000 .

[31]  Hishamuddin Jamaluddin,et al.  Optimum grouping in a modified genetic algorithm for discrete-time, non-linear system identification , 2007 .

[32]  Ali Jamali,et al.  Frequency-based reliability Pareto optimum design of proportional-integral-derivative controllers for systems with probabilistic uncertainty , 2007 .

[33]  Alina Patelli,et al.  Migration-based multiobjective genetic programming for nonlinear system identification , 2009, 2009 5th International Symposium on Applied Computational Intelligence and Informatics.

[34]  John J. Grefenstette,et al.  Optimization of Control Parameters for Genetic Algorithms , 1986, IEEE Transactions on Systems, Man, and Cybernetics.