On Controllability of Neuronal Networks With Constraints on the Average of Control Gains

Control gains play an important role in the control of a natural or a technical system since they reflect how much resource is required to optimize a certain control objective. This paper is concerned with the controllability of neuronal networks with constraints on the average value of the control gains injected in driver nodes, which are in accordance with engineering and biological backgrounds. In order to deal with the constraints on control gains, the controllability problem is transformed into a constrained optimization problem (COP). The introduction of the constraints on the control gains unavoidably leads to substantial difficulty in finding feasible as well as refining solutions. As such, a modified dynamic hybrid framework (MDyHF) is developed to solve this COP, based on an adaptive differential evolution and the concept of Pareto dominance. By comparing with statistical methods and several recently reported constrained optimization evolutionary algorithms (COEAs), we show that our proposed MDyHF is competitive and promising in studying the controllability of neuronal networks. Based on the MDyHF, we proceed to show the controlling regions under different levels of constraints. It is revealed that we should allocate the control gains economically when strong constraints are considered. In addition, it is found that as the constraints become more restrictive, the driver nodes are more likely to be selected from the nodes with a large degree. The results and methods presented in this paper will provide useful insights into developing new techniques to control a realistic complex network efficiently.

[1]  W. Singer,et al.  Neural Synchrony in Brain Disorders: Relevance for Cognitive Dysfunctions and Pathophysiology , 2006, Neuron.

[2]  J. Kurths,et al.  Structure–function relationship in complex brain networks expressed by hierarchical synchronization , 2007 .

[3]  C. Blakemore,et al.  Analysis of connectivity in the cat cerebral cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Stephen R. Marsland,et al.  Convergence Properties of (μ + λ) Evolutionary Algorithms , 2011, AAAI.

[5]  Xinping Guan,et al.  A Stackelberg Game for Spectrum Leasing in Cooperative Cognitive Radio Networks , 2013, Int. J. Autom. Comput..

[6]  David A. Van Veldhuizen,et al.  Evolutionary Computation and Convergence to a Pareto Front , 1998 .

[7]  Zidong Wang,et al.  Bounded $H_{\infty}$ Synchronization and State Estimation for Discrete Time-Varying Stochastic Complex Networks Over a Finite Horizon , 2011, IEEE Transactions on Neural Networks.

[8]  Yang Tang,et al.  Multiobjective synchronization of coupled systems. , 2011, Chaos.

[9]  Huijun Gao,et al.  Pinning Distributed Synchronization of Stochastic Dynamical Networks: A Mixed Optimization Approach , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Yide Ma,et al.  New Spiking Cortical Model for Invariant Texture Retrieval and Image Processing , 2009, IEEE Transactions on Neural Networks.

[11]  Guang-Ren Duan,et al.  Global Stabilization of the Double Integrator System With Saturation and Delay in the Input , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[12]  J. W. Harrison,et al.  The beginning of the end of the antibiotic era? Part II. Proposed solutions to antibiotic abuse. , 1998, Quintessence international.

[13]  F. Garofalo,et al.  Controllability of complex networks via pinning. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[15]  Huijun Gao,et al.  Distributed Synchronization in Networks of Agent Systems With Nonlinearities and Random Switchings , 2013, IEEE Transactions on Cybernetics.

[16]  Zidong Wang,et al.  State Estimation for Coupled Uncertain Stochastic Networks With Missing Measurements and Time-Varying Delays: The Discrete-Time Case , 2009, IEEE Transactions on Neural Networks.

[17]  M P Young,et al.  Anatomical connectivity defines the organization of clusters of cortical areas in the macaque monkey and the cat. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  Huaguang Zhang,et al.  Robust Global Exponential Synchronization of Uncertain Chaotic Delayed Neural Networks via Dual-Stage Impulsive Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  E. Kluge,et al.  Resource allocation in healthcare: implications of models of medicine as a profession. , 2007, MedGenMed : Medscape general medicine.

[20]  J. Kurths,et al.  Identifying Controlling Nodes in Neuronal Networks in Different Scales , 2012, PloS one.

[21]  Wenwu Yu,et al.  On pinning synchronization of complex dynamical networks , 2009, Autom..

[22]  Beom Jun Kim,et al.  Dynamics and directionality in complex networks. , 2009, Physical review letters.

[23]  Yong Wang,et al.  A Dynamic Hybrid Framework for Constrained Evolutionary Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Changsong Zhou,et al.  Hierarchical organization unveiled by functional connectivity in complex brain networks. , 2006, Physical review letters.

[25]  J. Avorn,et al.  The appropriateness of oral fluoroquinolone prescribing in the long-term care setting , 1995, International Urogynecology Journal.

[26]  Zongli Lin,et al.  Stability analysis of discrete-time systems with actuator saturation by a saturation-dependent Lyapunov function , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[27]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[28]  Marc-Thorsten Hütt,et al.  Organization of Excitable Dynamics in Hierarchical Biological Networks , 2008, PLoS Comput. Biol..

[29]  Albert-László Barabási,et al.  Controllability of complex networks , 2011, Nature.

[30]  Yang Tang,et al.  Exponential Synchronization of Coupled Switched Neural Networks With Mode-Dependent Impulsive Effects , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Huijun Gao,et al.  Multiobjective Identification of Controlling Areas in Neuronal Networks , 2013, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[32]  B. Ermentrout,et al.  Chemical and electrical synapses perform complementary roles in the synchronization of interneuronal networks. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Alex Arenas,et al.  From Modular to Centralized Organization of Synchronization in Functional Areas of the Cat Cerebral Cortex , 2010, PloS one.

[34]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[35]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[36]  Huijun Gao,et al.  Evolutionary Pinning Control and Its Application in UAV Coordination , 2012, IEEE Transactions on Industrial Informatics.

[37]  O. Sporns,et al.  Identification and Classification of Hubs in Brain Networks , 2007, PloS one.

[38]  Hai-Jiao Guo,et al.  Design of optimal output disturbance cancellation controllers via loop transfer recovery , 2013 .

[39]  Bing Li,et al.  Refactoring Software Packages via Community Detection in Complex Software Networks , 2013, Int. J. Autom. Comput..

[40]  Jekanthan Thangavelautham,et al.  Tackling Learning Intractability Through Topological Organization and Regulation of Cortical Networks , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[41]  M. A. O'Neil,et al.  The connectional organization of the cortico-thalamic system of the cat. , 1999, Cerebral cortex.

[42]  Mian Liu,et al.  Design of robotic visual servo control based on neural network and genetic algorithm , 2012, International Journal of Automation and Computing.

[43]  M. Egerstedt.  Complex networks: Degrees of control , 2011, Nature.

[44]  Huijun Gao,et al.  Distributed Robust Synchronization of Dynamical Networks With Stochastic Coupling , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[45]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[46]  Zongli Lin,et al.  Stability analysis of discrete-time systems with actuator saturation by a saturation-dependent Lyapunov function , 2003, Autom..

[47]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[48]  Xiao Fan Wang,et al.  Synchronization in scale-free dynamical networks: robustness and fragility , 2001, cond-mat/0105014.

[49]  Gorka Zamora-López,et al.  Cortical Hubs Form a Module for Multisensory Integration on Top of the Hierarchy of Cortical Networks , 2009, Front. Neuroinform..

[50]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[51]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[52]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[53]  Klaus-Dieter Thoben,et al.  Integration of supply networks for customization with modularity in cloud and make-to-upgrade strategy , 2013 .

[54]  J. Liang,et al.  Robust Synchronization of an Array of Coupled Stochastic Discrete-Time Delayed Neural Networks , 2008, IEEE Transactions on Neural Networks.

[55]  M Chavez,et al.  Synchronization in complex networks with age ordering. , 2005, Physical review letters.

[56]  Jinde Cao,et al.  Synchronization Control for Nonlinear Stochastic Dynamical Networks: Pinning Impulsive Strategy , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[57]  David Brown.  Degrees of Control , 1995 .

[58]  Karlene A. Hoo,et al.  Stability analysis for closed-loop management of a reservoir based on identification of reduced-order nonlinear model , 2013 .

[59]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[60]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[61]  Filip Piekniewski,et al.  Theoretical Model for Mesoscopic-Level Scale-Free Self-Organization of Functional Brain Networks , 2010, IEEE Transactions on Neural Networks.

[62]  Jack W Scannell,et al.  The connectional organization of neural systems in the cat cerebral cortex , 1993, Current Biology.

[63]  Hamid Reza Karimi,et al.  New Delay-Dependent Exponential $H_{\infty}$ Synchronization for Uncertain Neural Networks With Mixed Time Delays , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[64]  James Lam,et al.  A new delay system approach to network-based control , 2008, Autom..

[65]  Frank L. Lewis,et al.  Distributed Adaptive Tracking Control for Synchronization of Unknown Networked Lagrangian Systems , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[66]  Huijun Gao,et al.  A Constrained Evolutionary Computation Method for Detecting Controlling Regions of Cortical Networks , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[67]  Matt Welsh,et al.  Decentralized, adaptive resource allocation for sensor networks , 2005, NSDI.

[68]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[69]  Zidong Wang,et al.  Synchronization and State Estimation for Discrete-Time Complex Networks With Distributed Delays , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[70]  Zidong Wang,et al.  Global Synchronization Control of General Delayed Discrete-Time Networks With Stochastic Coupling and Disturbances , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[71]  Huijun Gao,et al.  New Delay-Dependent Exponential H ∞ Synchronization for Uncertain Neural Networks With Mixed Time Delays , 2009 .

[72]  M. Kothare,et al.  Robust constrained model predictive control using linear matrix inequalities , 1994, Proceedings of 1994 American Control Conference - ACC '94.