Neural Network Spectral Robustness under Perturbations of the Underlying Graph

Recent studies have been using graph-theoretical approaches to model complex networks (such as social, infrastructural, or biological networks) and how their hardwired circuitry relates to their dynamic evolution in time. Understanding how configuration reflects on the coupled behavior in a system of dynamic nodes can be of great importance, for example, in the context of how the brain connectome is affecting brain function. However, the effect of connectivity patterns on network dynamics is far from being fully understood. We study the connections between edge configuration and dynamics in a simple oriented network composed of two interconnected cliques (representative of brain feedback regulatory circuitry). In this article our main goal is to study the spectra of the graph adjacency and Laplacian matrices, with a focus on three aspects in particular: (1) the sensitivity and robustness of the spectrum in response to varying the intra- and intermodular edge density, (2) the effects on the spectrum of perturbing the edge configuration while keeping the densities fixed, and (3) the effects of increasing the network size. We study some tractable aspects analytically, then simulate more general results numerically, thus aiming to motivate and explain our further work on the effect of these patterns on the network temporal dynamics and phase transitions. We discuss the implications of such results to modeling brain connectomics. We suggest potential applications to understanding synaptic restructuring in learning networks and the effects of network configuration on function of regulatory neural circuits.

[1]  Paul M. Thompson,et al.  A Framework for Quantifying Node-Level Community Structure Group Differences in Brain Connectivity Networks , 2012, MICCAI.

[2]  Jukka-Pekka Onnela,et al.  Community Structure in Time-Dependent, Multiscale, and Multiplex Networks , 2009, Science.

[3]  Faraz Zaidi,et al.  Communities and hierarchical structures in dynamic social networks: analysis and visualization , 2011, Social Network Analysis and Mining.

[4]  Dan Schonfeld,et al.  Investigating brain community structure abnormalities in bipolar disorder using path length associated community estimation , 2014, Human brain mapping.

[5]  Magnus Egerstedt,et al.  Controllability of Multi-Agent Systems from a Graph-Theoretic Perspective , 2009, SIAM J. Control. Optim..

[6]  Yong He,et al.  Graph theoretical modeling of brain connectivity. , 2010, Current opinion in neurology.

[7]  S. N. Dorogovtsev,et al.  Spectra of complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[9]  Alexander Berglund,et al.  Shellability and the Strong gcd-Condition , 2008, Electron. J. Comb..

[10]  Lilianne R. Mujica-Parodi,et al.  Network connectivity modulates power spectrum scale invariance , 2014, NeuroImage.

[11]  Peter A. Robinson,et al.  Stability and structural constraints of random brain networks with excitatory and inhibitory neural populations , 2009, Journal of Computational Neuroscience.

[12]  E. Ott,et al.  Approximating the largest eigenvalue of network adjacency matrices. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Michael Small,et al.  The stability of networks --- towards a structural dynamical systems theory , 2012, ArXiv.

[14]  Fan Chung Graham,et al.  The Spectra of Random Graphs with Given Expected Degrees , 2004, Internet Math..

[15]  D. Long Networks of the Brain , 2011 .

[16]  M. Mesbahi,et al.  Relative Sensing Networks: Observability, Estimation, and the Control Structure , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[17]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[18]  Somwrita Sarkar,et al.  Spectral Characterization of Hierarchical Network Modularity and Limits of Modularity Detection , 2013, PloS one.

[19]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[20]  Bruno Cessac,et al.  Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons , 2007, Journal of Physiology-Paris.

[21]  Tomer Fekete,et al.  Combining Classification with fMRI-Derived Complex Network Measures for Potential Neurodiagnostics , 2013, PloS one.

[22]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[23]  Daniel B. Larremore,et al.  Efficiently inferring community structure in bipartite networks , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Liang Zhan,et al.  Impaired Inter-Hemispheric Integration in Bipolar Disorder Revealed with Brain Network Analyses , 2013, Biological Psychiatry.

[25]  A. Barabasi,et al.  Network medicine : a network-based approach to human disease , 2010 .

[26]  T. Elliott,et al.  Multiplicative Synaptic Normalization and a Nonlinear Hebb Rule Underlie a Neurotrophic Model of Competitive Synaptic Plasticity , 2002, Neural Computation.

[27]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[28]  Ilia Ponomarenko,et al.  Non-Isomorphic Graphs with Cospectral Symmetric Powers , 2009, Electron. J. Comb..

[29]  Raj Rao Nadakuditi,et al.  Spectra of random graphs with arbitrary expected degrees , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[30]  Beom Jun Kim,et al.  Synchronization in interdependent networks. , 2011, Chaos.

[31]  Olaf Sporns,et al.  Graph Theory Methods for the Analysis of Neural Connectivity Patterns , 2003 .

[32]  P. Whalen,et al.  The structural and functional connectivity of the amygdala: From normal emotion to pathological anxiety , 2011, Behavioural Brain Research.

[33]  Chai Wah Wu,et al.  Control of Networks of Coupled Dynamical Systems , 2013 .

[34]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[35]  Pienie Zwitserlood,et al.  Reduced amygdala-prefrontal coupling in major depression: association with MAOA genotype and illness severity. , 2009, The international journal of neuropsychopharmacology.

[36]  Olaf Sporns,et al.  The Non-Random Brain: Efficiency, Economy, and Complex Dynamics , 2010, Front. Comput. Neurosci..

[37]  R M Borisyuk,et al.  Dynamics and bifurcations of two coupled neural oscillators with different connection types , 1995, Bulletin of mathematical biology.

[38]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[39]  Kathryn B. Laskey,et al.  Stochastic blockmodels: First steps , 1983 .

[40]  Ferenc Juhfisz On the Characteristic Values of Non-symmetric Block Random Matrices , 2004 .

[41]  E. Ott,et al.  Spectral properties of networks with community structure. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Daniel L. Rubin,et al.  Network Analysis of Intrinsic Functional Brain Connectivity in Alzheimer's Disease , 2008, PLoS Comput. Biol..

[43]  Sergio Oscar Verduzco-Flores,et al.  Nonlinear network dynamics under perturbations of the underlying graph. , 2014, Chaos.

[44]  Paul M. Thompson,et al.  Constructing the resting state structural connectome , 2013, Front. Neuroinform..

[45]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[46]  Roy S. Smith,et al.  Closed-Loop Dynamics of Cooperative Vehicle Formations With Parallel Estimators and Communication , 2007, IEEE Transactions on Automatic Control.

[47]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[48]  Nathan Intrator,et al.  Theory of Cortical Plasticity: (With Software Package “PLASTICITY”) , 2004 .

[49]  F. Chung,et al.  Complex Graphs and Networks , 2006 .

[50]  Daniel Zelazo,et al.  Graph-theoretic methods for the analysis and synthesis of networked dynamic systems , 2009 .

[51]  Lee A. Segel,et al.  A basic biophysical model for bursting neurons , 1993, Biological Cybernetics.

[52]  Fabrizio Lillo,et al.  Modelling the air transport with complex networks: A short review , 2013, The European Physical Journal Special Topics.

[53]  Potsdam,et al.  Complex networks in climate dynamics. Comparing linear and nonlinear network construction methods , 2009, 0907.4359.

[54]  Raj Rao Nadakuditi,et al.  Graph spectra and the detectability of community structure in networks , 2012, Physical review letters.

[55]  Aaron Clauset,et al.  Adapting the Stochastic Block Model to Edge-Weighted Networks , 2013, ArXiv.

[56]  Keith Heberlein,et al.  Imaging human connectomes at the macroscale , 2013, Nature Methods.

[57]  Geoffrey J. Goodhill,et al.  Topography and ocular dominance: a model exploring positive correlations , 1993, Biological Cybernetics.

[58]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[59]  Nathan Intrator,et al.  Theory of Cortical Plasticity , 2004 .

[60]  Kenneth D. Miller,et al.  The Role of Constraints in Hebbian Learning , 1994, Neural Computation.

[61]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[62]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[63]  Maurizio Corbetta,et al.  Functional connectivity and neurological recovery. , 2012, Developmental psychobiology.

[64]  A. Barabasi,et al.  Spectra of "real-world" graphs: beyond the semicircle law. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  P. Whalen,et al.  The Structural Integrity of an Amygdala–Prefrontal Pathway Predicts Trait Anxiety , 2009, The Journal of Neuroscience.

[66]  Piet Van Mieghem,et al.  The N-intertwined SIS epidemic network model , 2011, Computing.

[67]  A. Toga,et al.  Mapping the human connectome. , 2012, Neurosurgery.