Design controller for synchronization of an array of delayed neural networks using a controllable probabilistic PSO I

This paper introduces a controllable probabilistic particle swarm optimization (CPPSO) algorithm based on Bernoulli stochastic variables and a competitive penalized method. The CPPSO is proposed to solve optimization problems and is applied to design the memoryless feedback controller, which is used in synchronization of an array of delayed neural networks (DNNs). The learning strategies occur in a random way and are governed by Bernoulli stochastic variables. The expectation of Bernoulli stochastic variables are automatically controlled by search environment. The proposed method not only keeps the diversity of the swarm, but also maintains rapid convergence of the PSO according to a competitive penalized mechanism. In addition, the convergence speed is improved because the inertia weight each particle is automatically computed according to the feedback of fltness value. The e‐ciency of the proposed CPPSO is demonstrated by comparing it with some well-known PSO algorithms on benchmark test functions with and without rotation. In the end, the proposed CPPSO algorithm is used to design the controller for synchronization of an array of continuous-time delayed neural networks.

[1]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[2]  Guanrong Chen,et al.  Chaos synchronization of general complex dynamical networks , 2004 .

[3]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[4]  Fuwen Yang,et al.  Robust $H_{\infty}$ Control for Networked Systems With Random Packet Losses , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[6]  Carroll,et al.  Synchronization in chaotic systems. , 1990, Physical review letters.

[7]  Chai Wah Wu,et al.  Synchronization in arrays of coupled nonlinear systems with delay and nonreciprocal time-varying coupling , 2005, IEEE Transactions on Circuits and Systems II: Express Briefs.

[8]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[9]  Yang Tang,et al.  Delay-distribution-dependent stability of stochastic discrete-time neural networks with randomly mixed time-varying delays , 2009, Neurocomputing.

[10]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[11]  Guanrong Chen,et al.  Global Synchronization of Coupled Delayed Neural Networks and Applications to Chaotic CNN Models , 2004, Int. J. Bifurc. Chaos.

[12]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[13]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[14]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[15]  Runhe Qiu,et al.  Adaptive lag synchronization in unknown stochastic chaotic neural networks with discrete and distributed time-varying delays☆ , 2008 .

[16]  Fuwen Yang,et al.  Robust finite-horizon filtering for stochastic systems with missing measurements , 2005, IEEE Signal Processing Letters.

[17]  Jinde Cao,et al.  Global synchronization in arrays of delayed neural networks with constant and delayed coupling , 2006 .

[18]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Tianping Chen,et al.  Synchronization analysis of linearly coupled networks of discrete time systems , 2004 .

[20]  Zidong Wang,et al.  Robust passivity and passification of stochastic fuzzy time-delay systems , 2010, Inf. Sci..

[21]  Tianping Chen,et al.  Synchronization of coupled connected neural networks with delays , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[22]  Jinde Cao,et al.  Global Synchronization of Linearly Hybrid Coupled Networks with Time-Varying Delay , 2008, SIAM J. Appl. Dyn. Syst..

[23]  Yujia Wang,et al.  Particle swarm optimization with preference order ranking for multi-objective optimization , 2009, Inf. Sci..

[24]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[25]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[26]  Boris Leonidovich Pasternak,et al.  Collected Works (In Russian)@@@In the Interlude, Poems 1945-1960 , 1963 .

[27]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[28]  Charles M. Gray,et al.  Synchronous oscillations in neuronal systems: Mechanisms and functions , 1994, Journal of Computational Neuroscience.

[29]  J. Liang,et al.  Robust Synchronization of an Array of Coupled Stochastic Discrete-Time Delayed Neural Networks , 2008, IEEE Transactions on Neural Networks.

[30]  Leandro dos Santos Coelho,et al.  Coevolutionary Particle Swarm Optimization Using Gaussian Distribution for Solving Constrained Optimization Problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Daniel W. C. Ho,et al.  Variance-constrained filtering for uncertain stochastic systems with missing measurements , 2003, IEEE Trans. Autom. Control..

[32]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[33]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[34]  Paul S. Andrews,et al.  An Investigation into Mutation Operators for Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[35]  Yang Tang,et al.  Robust synchronization in an array of fuzzy delayed cellular neural networks with stochastically hybrid coupling , 2009, Neurocomputing.

[36]  Guanrong Chen,et al.  New criteria for synchronization stability of general complex dynamical networks with coupling delays , 2006 .

[37]  Zidong Wang,et al.  Pinning control of fractional-order weighted complex networks. , 2009, Chaos.

[38]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.