Neural network function, density or geometry?

We consider an oriented network in which two subgraphs (modules X and Y), with a given intra-modular edge density, are inter-connected by a fixed number of edges, in both directions. We study the adjacency spectrum of this network, focusing in particular on two aspects: the changes in the spectrum in response to varying the intra and inter-modular edge density, and the effects on the spectrum of perturbing the edge configuration, while keeping the densities fixed. Since the general case is quite complex analytically, we adopted a combination of analytical approaches to particular cases, and numerical simulations for more results. After investigating the behavior of the mean and standard deviation of the eigenvalues, we conjectured the robustness of the adjacency spectrum to variations in edge geometry, when operating under a fixed density profile. We remark that, while this robustness increases with the size N of the network, it emerges at small sizes, and should not be thought of as a property that holds only in the large N limit. We argue that this may be helpful when studying applications on small networks of nodes. We interpret our results in the context of existing literature, which has been placing increasing attention to random graph models, with edges connecting two given nodes with certain probabilities. We discuss whether properties such as Wigner's semicircle law, or effects of community structure, still hold in our context. Finally, we suggest possible applications of the model to understanding synaptic restructuring during learning algorithms, and to classifying emotional responses based on the geometry of the emotion-regulatory neural circuit. In this light, we argue that future directions should be directed towards relating hardwiring to the temporal behavior of the network as a dynamical system .

[1]  Nathan Intrator,et al.  Theory of Cortical Plasticity , 2004 .

[2]  Kenneth D. Miller,et al.  The Role of Constraints in Hebbian Learning , 1994, Neural Computation.

[3]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[4]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[5]  Raj Rao Nadakuditi,et al.  Graph spectra and the detectability of community structure in networks , 2012, Physical review letters.

[6]  Chai Wah Wu,et al.  Control of Networks of Coupled Dynamical Systems , 2013 .

[7]  Maurizio Corbetta,et al.  Functional connectivity and neurological recovery. , 2012, Developmental psychobiology.

[8]  Keith Heberlein,et al.  Imaging human connectomes at the macroscale , 2013, Nature Methods.

[9]  P. Whalen,et al.  The structural and functional connectivity of the amygdala: From normal emotion to pathological anxiety , 2011, Behavioural Brain Research.

[10]  Pienie Zwitserlood,et al.  Reduced amygdala-prefrontal coupling in major depression: association with MAOA genotype and illness severity. , 2009, The international journal of neuropsychopharmacology.

[11]  Olaf Sporns,et al.  The Non-Random Brain: Efficiency, Economy, and Complex Dynamics , 2010, Front. Comput. Neurosci..

[12]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[13]  Michael Small,et al.  The stability of networks --- towards a structural dynamical systems theory , 2012, ArXiv.

[14]  Fan Chung Graham,et al.  The Spectra of Random Graphs with Given Expected Degrees , 2004, Internet Math..

[15]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[16]  Lilianne R. Mujica-Parodi,et al.  Network connectivity modulates power spectrum scale invariance , 2014, NeuroImage.

[17]  Olaf Sporns,et al.  Graph Theory Methods for the Analysis of Neural Connectivity Patterns , 2003 .

[18]  E. Ott,et al.  Spectral properties of networks with community structure. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Mehran Mesbahi,et al.  H2 analysis and synthesis of networked dynamic systems , 2009, 2009 American Control Conference.

[20]  Paul M. Thompson,et al.  Constructing the resting state structural connectome , 2013, Front. Neuroinform..

[21]  Paul M. Thompson,et al.  A Framework for Quantifying Node-Level Community Structure Group Differences in Brain Connectivity Networks , 2012, MICCAI.

[22]  Raj Rao Nadakuditi,et al.  Spectra of random graphs with arbitrary expected degrees , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Faraz Zaidi,et al.  Communities and hierarchical structures in dynamic social networks: analysis and visualization , 2011, Social Network Analysis and Mining.

[24]  A. Barabasi,et al.  Spectra of "real-world" graphs: beyond the semicircle law. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Bruno Cessac,et al.  Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons , 2007, Journal of Physiology-Paris.

[26]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[27]  P. Whalen,et al.  The Structural Integrity of an Amygdala–Prefrontal Pathway Predicts Trait Anxiety , 2009, The Journal of Neuroscience.

[28]  A. Toga,et al.  Mapping the human connectome. , 2012, Neurosurgery.

[29]  T. Elliott,et al.  Multiplicative Synaptic Normalization and a Nonlinear Hebb Rule Underlie a Neurotrophic Model of Competitive Synaptic Plasticity , 2002, Neural Computation.

[30]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[31]  Lee A. Segel,et al.  A basic biophysical model for bursting neurons , 1993, Biological Cybernetics.

[32]  Fabrizio Lillo,et al.  Modelling the air transport with complex networks: A short review , 2013, The European Physical Journal Special Topics.

[33]  Potsdam,et al.  Complex networks in climate dynamics. Comparing linear and nonlinear network construction methods , 2009, 0907.4359.

[34]  Ferenc Juhfisz On the Characteristic Values of Non-symmetric Block Random Matrices , 2004 .

[35]  Sergio Oscar Verduzco-Flores,et al.  Nonlinear network dynamics under perturbations of the underlying graph. , 2014, Chaos.

[36]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[37]  Roy S. Smith,et al.  Closed-Loop Dynamics of Cooperative Vehicle Formations With Parallel Estimators and Communication , 2007, IEEE Transactions on Automatic Control.

[38]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[39]  Yong He,et al.  Graph theoretical modeling of brain connectivity. , 2010, Current opinion in neurology.

[40]  Piet Van Mieghem,et al.  On Synchronization of Interdependent Networks , 2013, ArXiv.

[41]  S. N. Dorogovtsev,et al.  Spectra of complex networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[43]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[44]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[45]  Peter A. Robinson,et al.  Stability and structural constraints of random brain networks with excitatory and inhibitory neural populations , 2009, Journal of Computational Neuroscience.

[46]  E. Ott,et al.  Approximating the largest eigenvalue of network adjacency matrices. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[47]  D. Long Networks of the Brain , 2011 .

[48]  Somwrita Sarkar,et al.  Spectral Characterization of Hierarchical Network Modularity and Limits of Modularity Detection , 2013, PloS one.

[49]  F. Chung,et al.  Complex Graphs and Networks , 2006 .

[50]  Karl J. Friston,et al.  Structural and Functional Brain Networks: From Connections to Cognition , 2013, Science.

[51]  Geoffrey J. Goodhill,et al.  Topography and ocular dominance: a model exploring positive correlations , 1993, Biological Cybernetics.