Robust identification of nonlinear complex systems using low complexity ANN and particle swarm optimization technique

The paper introduces a novel method of adaptive robust identification of complex nonlinear dynamic plants including Box Jenkin, Mackey Glass and Sunspot series under the presence of strong outliers in the training samples. The identification model consists of a low complexity single layer functional link artificial neural network (FLANN) in the feed forward path and another on the feedback path. The connecting weights are iteratively adjusted by a population based particle swarm optimization technique so that a robust cost function (RCF) of the model-error is minimized. To demonstrate robust identification performance up to 50% random samples of the plant output is contaminated with strong outliers and are employed for training the model using PSO tool. Identification of wide varieties of benchmark complex static and dynamic plants is carried out through simulation study and the performance obtained are compared with those obtained from using standard squared error norm as CF. It is in general observed that, the Wilcoxon norm provides best identification performance compared to squared error and other RCFs based models.

[1]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[2]  M. Moraud.  Wavelet Networks , 2018, Foundations of Wavelet Networks and Applications.

[3]  Ramesh C. Jain,et al.  A robust backpropagation learning algorithm for function approximation , 1994, IEEE Trans. Neural Networks.

[4]  Pao-Ta Yu,et al.  On the optimal design of fuzzy neural networks with robust learning for function approximation , 2000, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Hak-Keung Lam,et al.  Hybrid Particle Swarm Optimization With Wavelet Mutation and Its Industrial Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Yung C. Shin,et al.  Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[7]  Mohamed A. El-Sharkawi,et al.  Dynamic security border identification using enhanced particle swarm optimization , 2002 .

[8]  Amir F. Atiya,et al.  Application of the recurrent multilayer perceptron in modeling complex process dynamics , 1994, IEEE Trans. Neural Networks.

[9]  Alex ChiChung Kot,et al.  Nonlinear dynamic system identification using Chebyshev functional link artificial neural networks , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[10]  Jacek M. Zurada,et al.  An approach to multimodal biomedical image registration utilizing particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[11]  Gabriela Cembrano,et al.  Dynamic control of a robot arm using CMAC neural networks , 1997 .

[12]  Song-Shyong Chen,et al.  Robust TSK fuzzy modeling for function approximation with outliers , 2001, IEEE Trans. Fuzzy Syst..

[13]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[14]  N. P. Padhy,et al.  Application of particle swarm optimization technique and its variants to generation expansion planning problem , 2004 .

[15]  M. A. Abido,et al.  Optimal power flow using particle swarm optimization , 2002 .

[16]  M. A. Abido.  Optimal des'ign of Power System Stabilizers Using Particle Swarm Opt'imization , 2002, IEEE Power Engineering Review.

[17]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[18]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[19]  Ganapati Panda,et al.  Identification of nonlinear dynamic systems using functional link artificial neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[20]  Joong-Rin Shin,et al.  A particle swarm optimization for economic dispatch with nonsmooth cost functions , 2005, IEEE Transactions on Power Systems.

[21]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[22]  T.O. Ting,et al.  A novel approach for unit commitment problem via an effective hybrid particle swarm optimization , 2006, IEEE Transactions on Power Systems.

[23]  Shun-Feng Su,et al.  Robust support vector regression networks for function approximation with outliers , 2002, IEEE Trans. Neural Networks.

[24]  Kadir Liano,et al.  Robust error measure for supervised neural network learning with outliers , 1996, IEEE Trans. Neural Networks.

[25]  S. Kannan,et al.  Application and comparison of metaheuristic techniques to generation expansion planning problem , 2005, IEEE Transactions on Power Systems.

[26]  Wei Zhang,et al.  Image segmentation with 2-D maximum entropy based on comprehensive learning particle swarm optimization , 2007, 2007 IEEE International Conference on Automation and Logistics.

[27]  G. Lambert-Torres,et al.  A hybrid particle swarm optimization applied to loss power minimization , 2005, IEEE Transactions on Power Systems.

[28]  Andreas S. Weigend,et al.  The Future of Time Series: Learning and Understanding , 1993 .

[29]  Dean J. Krusienski,et al.  Particle swarm optimization for adaptive IIR filter structures , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[30]  Julian Togelius,et al.  Geometric particle swarm optimization , 2008 .

[31]  A. V.DavidSánchez,et al.  Robustization of a learning method for RBF networks , 1995, Neurocomputing.

[32]  Chi-Hsu Wang,et al.  Function approximation using fuzzy neural networks with robust learning algorithm , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[33]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[34]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  A.P. Engelbrecht,et al.  Learning to play games using a PSO-based competitive learning approach , 2004, IEEE Transactions on Evolutionary Computation.

[36]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[37]  L. Coelho.  Novel Gaussian quantum-behaved particle swarm optimiser applied to electromagnetic design , 2007 .

[38]  Jianming Zhang,et al.  Application of particle swarm optimization algorithm for weighted fuzzy rule-based system , 2004, 30th Annual Conference of IEEE Industrial Electronics Society, 2004. IECON 2004.

[39]  T.A.A. Victoire,et al.  Reserve constrained dynamic dispatch of units with valve-point effects , 2005, IEEE Transactions on Power Systems.

[40]  Joseph W. McKean,et al.  Robust Analysis of Linear Models , 2004 .

[41]  Ganapati Panda,et al.  Identification of nonlinear systems using particle swarm optimization technique , 2007, 2007 IEEE Congress on Evolutionary Computation.

[42]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[43]  J.G. Vlachogiannis,et al.  Determining generator contributions to transmission system using parallel vector evaluated particle swarm optimization , 2005, IEEE Transactions on Power Systems.

[44]  Albert A. Groenwold,et al.  Sizing design of truss structures using particle swarms , 2003 .

[45]  Ganapati Panda,et al.  Prediction of S&P 500 and DJIA stock indices using Particle Swarm Optimization technique , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[46]  Zwe-Lee Gaing,et al.  Particle swarm optimization to solving the economic dispatch considering the generator constraints , 2003 .

[47]  H. Yoshida,et al.  A particle swarm optimization for reactive power and voltage control considering voltage security assessment , 1999, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[48]  Jing J. Liang,et al.  Design of Yagi-Uda antennas using comprehensive learning particle swarm optimisation , 2005 .

[49]  Zwe-Lee Gaing.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004, IEEE Transactions on Energy Conversion.

[50]  Yaowu Wu,et al.  A PSO-based approach to optimal capacitor placement with harmonic distortion consideration , 2004 .

[51]  S. Galvani,et al.  A particle swarm optimization approach for optimum design of PID controller in linear elevator , 2010, 2010 Conference Proceedings IPEC.

[52]  B. Widrow,et al.  Neural networks for self-learning control systems , 1990, IEEE Control Systems Magazine.

[53]  Yih-Lon Lin,et al.  Preliminary Study on Wilcoxon Learning Machines , 2008, IEEE Transactions on Neural Networks.

[54]  L. S. Moulin,et al.  Dynamic Security Border Identification Using Enhanced Particle Swarm Optimization , 2002, IEEE Power Engineering Review.

[55]  Chuangxin Guo,et al.  A multiagent-based particle swarm optimization approach for optimal reactive power dispatch , 2005 .

[56]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[57]  Changle Zhou,et al.  Multipoint Organizational Evolutionary Algorithm for Globally Minimizing Functions of Many Variables , 2007, 2007 2nd International Conference on Pervasive Computing and Applications.

[58]  Les E. Atlas,et al.  Recurrent neural networks and robust time series prediction , 1994, IEEE Trans. Neural Networks.

[59]  P. S. Sastry,et al.  Memory neuron networks for identification and control of dynamical systems , 1994, IEEE Trans. Neural Networks.

[60]  Chao-Ming Huang,et al.  A particle swarm optimization to identifying the ARMAX model for short-term load forecasting , 2005 .

[61]  Lei Huang,et al.  Robust interval regression analysis using neural networks , 1998, Fuzzy Sets Syst..

[62]  Yagyensh C. Pati,et al.  Analysis and synthesis of feedforward neural networks using discrete affine wavelet transformations , 1993, IEEE Trans. Neural Networks.

[63]  Chein-I Chang,et al.  Robust radial basis function neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.