PERTURBATION PARAMETERS TUNING OF MULTI-OBJECTIVE OPTIMIZATION DIFFERENTIAL EVOLUTION AND ITS APPLICATION TO DYNAMIC SYSTEM MODELING

This paper presents perturbation parameters for tuning of multi-objective optimization differential evolution and its application to dynamic system modeling. The perturbation of the proposed algorithm was composed of crossover and mutation operators.  Initially, a set of parameter values was tuned vigorously by executing multiple runs of algorithm for each proposed parameter variation. A set of values for crossover and mutation rates were proposed in executing the algorithm for model structure selection in dynamic system modeling. The model structure selection was one of the procedures in the system identification technique. Most researchers focused on the problem in selecting the parsimony model as the best represented the dynamic systems. Therefore, this problem needed two objective functions to overcome it, i.e. minimum predictive error and model complexity.  One of the main problems in identification of dynamic systems is to select the minimal model from the huge possible models that need to be considered. Hence, the important concepts in selecting good and adequate model used in the proposed algorithm were elaborated, including the implementation of the algorithm for modeling dynamic systems. Besides, the results showed that multi-objective optimization differential evolution performed better with tuned perturbation parameters.

[1]  David B. Fogel,et al.  Evolution-ary Computation 1: Basic Algorithms and Operators , 2000 .

[2]  Stephen A. Billings,et al.  An adaptive orthogonal search algorithm for model subset selection and non-linear system identification , 2008, Int. J. Control.

[3]  Sheng Chen,et al.  Model selection approaches for non-linear system identification: a review , 2008, Int. J. Syst. Sci..

[4]  Sandra Paterlini,et al.  Multiobjective optimization using differential evolution for real-world portfolio optimization , 2011, Comput. Manag. Sci..

[5]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[6]  Jianfeng Guo,et al.  Multi-objective optimal PMU placement using a non-dominated sorting differential evolution algorithm , 2010 .

[7]  Josiah Adeyemo,et al.  Multi-Objective Differential Evolution Algorithm for Solving Engineering Problems , 2009 .

[8]  Hishamuddin Jamaluddin,et al.  Dynamic System Modeling of Flexible Beam System Using Multi-Objective Optimization Differential Evolution Algorithm , 2014 .

[9]  Shigeru Okuma,et al.  Nonlinear system identification using genetic algorithm , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[10]  Mohd Azlan Hussain,et al.  Model structure selection for a discrete-time non-linear system using a genetic algorithm , 2004 .

[11]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[12]  Mohd Zakimi Zakaria,et al.  Effects of genetic algorithm parameters on multiobjective optimization algorithm applied to system identification problem , 2011, 2011 Fourth International Conference on Modeling, Simulation and Applied Optimization.

[13]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[14]  B. V. Babu,et al.  Multiobjective differential evolution (MODE) for optimization of adiabatic styrene reactor , 2005 .

[15]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[16]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[17]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[18]  Carlos M. Fonseca,et al.  'Identifying the structure of nonlinear dynamic systems using multiobjective genetic programming , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[19]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[20]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[21]  Lennart Ljung,et al.  Modeling Of Dynamic Systems , 1994 .

[22]  Lennart Ljung,et al.  Regressor and structure selection in NARX models using a structured ANOVA approach , 2008, Autom..

[23]  Marzuki Khalid,et al.  Structure optimization of neural network for dynamic system modeling using multi-objective genetic algorithm , 2011, Neural Computing and Applications.

[24]  Rolf Johansson,et al.  System modeling and identification , 1993 .

[25]  Sayed Mohammad Reza Loghmanian,et al.  Comparison between multi-objective and single-objective optimization for the modeling of dynamic systems , 2012, J. Syst. Control. Eng..

[26]  S. Billings,et al.  Algorithms for minimal model structure detection in nonlinear dynamic system identification , 1997 .

[27]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[28]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[29]  A. E. Eiben,et al.  Parameter tuning for configuring and analyzing evolutionary algorithms , 2011, Swarm Evol. Comput..

[30]  Hussein A. Abbass,et al.  The Pareto Differential Evolution Algorithm , 2002, Int. J. Artif. Intell. Tools.

[31]  Luis A. Aguirre On the structure of nonlinear polynomial models: higher order correlation functions, spectra, and term clusters , 1997 .

[32]  Jouni Lampinen,et al.  An easy‐to‐implement differential evolution approach for multi‐objective optimizations , 2006 .

[33]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[34]  Sheng Chen,et al.  Representations of non-linear systems: the NARMAX model , 1989 .

[35]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[36]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.