Polynomial modeling for time-varying systems based on a particle swarm optimization algorithm

In this paper, an effective particle swarm optimization (PSO) is proposed for polynomial models for time varying systems. The basic operations of the proposed PSO are similar to those of the classical PSO except that elements of particles represent arithmetic operations and variables of time-varying models. The performance of the proposed PSO is evaluated by polynomial modeling based on various sets of time-invariant and time-varying data. Results of polynomial modeling in time-varying systems show that the proposed PSO outperforms commonly used modeling methods which have been developed for solving dynamic optimization problems including genetic programming (GP) and dynamic GP. An analysis of the diversity of individuals of populations in the proposed PSO and GP reveals why the proposed PSO obtains better results than those obtained by GP.

[1]  Toshiyuki Murakami,et al.  Null Space Motion Control by PID Control Considering Passivity in Redundant Manipulator , 2008, IEEE Transactions on Industrial Informatics.

[2]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[3]  Dennis Gabor,et al.  A universal nonlinear filter, predictor and simulator which optimizes itself by a learning process , 1961 .

[4]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[5]  Erik D. Goodman,et al.  Knowledge interaction with genetic programming in mechatronic systems design using bond graphs , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Ferenc Szeifert,et al.  Genetic programming for the identification of nonlinear input-output models , 2005 .

[7]  Sebastián Ventura,et al.  G3P-MI: A genetic programming algorithm for multiple instance learning , 2010, Inf. Sci..

[8]  Gary G. Yen,et al.  Dynamic Evolutionary Algorithm With Variable Relocation , 2009, IEEE Transactions on Evolutionary Computation.

[9]  Hussein A. Abbass,et al.  Toward an Alternative Comparison between Different Genetic Programming Systems , 2004, EuroGP.

[10]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[11]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[12]  Robert I. McKay,et al.  Fitness Sharing in Genetic Programming , 2000, GECCO.

[13]  Pin Luarn,et al.  A discrete version of particle swarm optimization for flowshop scheduling problems , 2007, Comput. Oper. Res..

[14]  Jan Karel Lenstra,et al.  A local search template , 1998, Comput. Oper. Res..

[15]  Tzuu-Hseng S. Li,et al.  EP-based kinematic control and adaptive fuzzy sliding-mode dynamic control for wheeled mobile robots , 2009, Inf. Sci..

[16]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer for noisy and dynamic environments , 2006, Genetic Programming and Evolvable Machines.

[17]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[18]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[19]  K. Ohnishi,et al.  Real-time gait planning for pushing motion of humanoid robot , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[20]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[21]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Ki H. Chon,et al.  Representation of Time-Varying Nonlinear Systems With Time-Varying Principal Dynamic Modes , 2007, IEEE Transactions on Biomedical Engineering.

[23]  Colin R. Reeves,et al.  Genetic Algorithms and Neighbourhood Search , 1994, Evolutionary Computing, AISB Workshop.

[24]  Afshin Izadian,et al.  Fault Diagnosis of Time-Varying Parameter Systems With Application in MEMS LCRs , 2009, IEEE Transactions on Industrial Electronics.

[25]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[26]  Zbigniew Michalewicz,et al.  Time Series Forecasting for Dynamic Environments: The DyFor Genetic Program Model , 2007, IEEE Transactions on Evolutionary Computation.

[27]  Antonio J. Rivera,et al.  GP-COACH: Genetic Programming-based learning of COmpact and ACcurate fuzzy rule-based classification systems for High-dimensional problems , 2010, Inf. Sci..

[28]  Carlos M. Fonseca,et al.  'Identifying the structure of nonlinear dynamic systems using multiobjective genetic programming , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[29]  Bir Bhanu,et al.  Object detection via feature synthesis using MDL-based genetic programming , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[30]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[31]  Duen-Ren Liu,et al.  A hybrid of sequential rules and collaborative filtering for product recommendation , 2009, Inf. Sci..

[32]  Gang Chen,et al.  Coordinating Agents in Shop Floor Environments From a Dynamic Systems Perspective , 2006, IEEE Transactions on Industrial Informatics.

[33]  Nikhil R. Pal,et al.  Genetic programming for simultaneous feature selection and classifier design , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  John R. Koza,et al.  Genetic programming 2 - automatic discovery of reusable programs , 1994, Complex Adaptive Systems.

[35]  Mehmet Fatih Tasgetiren,et al.  A discrete particle swarm optimization algorithm for the no-wait flowshop scheduling problem , 2008, Comput. Oper. Res..

[36]  Gang Li,et al.  Instruction-Matrix-Based Genetic Programming , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Xin Yao,et al.  Population-Based Incremental Learning With Associative Memory for Dynamic Environments , 2008, IEEE Transactions on Evolutionary Computation.

[38]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[39]  Andries Petrus Engelbrecht,et al.  Genetic algorithms for the structural optimisation of learned polynomial expressions , 2007, Appl. Math. Comput..

[40]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[41]  Anikó Ekárt,et al.  A Metric for Genetic Programs and Fitness Sharing , 2000, EuroGP.

[42]  Sung-Kwun Oh,et al.  Multi-layer self-organizing polynomial neural networks and their development with the use of genetic algorithms , 2006, J. Frankl. Inst..

[43]  Ching-Jong Liao,et al.  A discrete particle swarm optimization for lot-streaming flowshop scheduling problem , 2008, Eur. J. Oper. Res..

[44]  Sheng Chen,et al.  Identification of non-linear output-affine systems using an orthogonal least-squares algorithm , 1988 .

[45]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[46]  Yujia Wang,et al.  Particle swarm optimization with preference order ranking for multi-objective optimization , 2009, Inf. Sci..

[47]  Graham Kendall,et al.  Diversity in genetic programming: an analysis of measures and correlation with fitness , 2004, IEEE Transactions on Evolutionary Computation.

[48]  HerreraFrancisco,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms' behaviour , 2009 .

[49]  Yuehui Chen,et al.  Time-series forecasting using a system of ordinary differential equations , 2011, Inf. Sci..

[50]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[51]  Tao Li,et al.  Improved delay-dependent bounded real lemma for uncertain time-delay systems , 2009, Inf. Sci..

[52]  John R. Koza,et al.  Routine high-return human-competitive automated problem-solving by means of genetic programming , 2008, Inf. Sci..

[53]  Anthony Brabazon,et al.  Grammatical Swarm: The generation of programs by social programming , 2006, Natural Computing.

[54]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[55]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[56]  Mark J. Willis,et al.  Steady-state modelling of chemical process systems using genetic programming , 1997 .

[57]  Kouhei Ohnishi,et al.  Stability Analysis and Practical Design Procedure of Time Delayed Control Systems With Communication Disturbance Observer , 2008, IEEE Transactions on Industrial Informatics.

[58]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[59]  Hitoshi Iba,et al.  Inference of differential equation models by genetic programming , 2002, Inf. Sci..

[60]  Conor Ryan,et al.  Grammatical Evolution , 2001, Genetic Programming Series.

[61]  Bart Naudts,et al.  A comparison of predictive measures of problem difficulty in evolutionary algorithms , 2000, IEEE Trans. Evol. Comput..

[62]  Asoke K. Nandi,et al.  Robust Text-Independent Speaker Verification Using Genetic Programming , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[63]  Anthony Brabazon,et al.  Grammatical Swarm , 2004, GECCO.

[64]  Changhe Li,et al.  A Generalized Approach to Construct Benchmark Problems for Dynamic Optimization , 2008, SEAL.

[65]  R.W. Morrison,et al.  A test problem generator for non-stationary environments , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[66]  Bernhard Sendhoff,et al.  Constructing Dynamic Optimization Test Problems Using the Multi-objective Optimization Concept , 2004, EvoWorkshops.