Incorporating Latent Constraints to Enhance Inference of Network Structure

A complex network is a model representation of interactions within technological, social, information, and biological networks. Oftentimes, we are interested in identifying the underlying network structure from limited and noisy observational data, which is a challenging problem. Here, to address this problem, we propose a novel and effective technique that incorporates latent structural constraints into binary compressed sensing. We show high accuracy and robust effectiveness of our proposed method by analyzing artificial small-world and scale-free networks, as well as two empirical networks. Our method requires a relatively small number of observations and it is robust against strong measurement noise. These results suggest that incorporating latent structural constraints into an algorithm for identifying the underlying network structure improves the inference of connections in complex networks.

[1]  Haibo He,et al.  Integrated Security Analysis on Cascading Failure in Complex Networks , 2014, IEEE Transactions on Information Forensics and Security.

[2]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[3]  Xian-Da Zhang,et al.  Matrix Analysis and Applications , 2017 .

[4]  Danny Dolev,et al.  Fault Identification Via Nonparametric Belief Propagation , 2009, IEEE Transactions on Signal Processing.

[5]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[6]  Bor-Sen Chen,et al.  Estimating Sensorimotor Mapping From Stimuli to Behaviors to Infer C. elegans Movements by Neural Transmission Ability Through Connectome Databases , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Daniel W. C. Ho,et al.  Pinning Stabilization of Linearly Coupled Stochastic Neural Networks via Minimum Number of Controllers , 2009, IEEE Transactions on Neural Networks.

[8]  Shengli Zhou,et al.  Sparse channel estimation for multicarrier underwater acoustic communication: From subspace methods to compressed sensing , 2009, OCEANS 2009-EUROPE.

[9]  Jun Tanimoto,et al.  Network reciprocity by coexisting learning and teaching strategies. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Feng Li,et al.  The complete connectome of a learning and memory centre in an insect brain , 2017, Nature.

[11]  Zidong Wang,et al.  Variance-Constrained State Estimation for Complex Networks With Randomly Varying Topologies , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Jieping Ye,et al.  Network Reconstruction Based on Evolutionary-Game Data via Compressive Sensing , 2011, Physical Review X.

[13]  S. Brenner,et al.  The structure of the nervous system of the nematode Caenorhabditis elegans. , 1986, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[14]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[15]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[16]  M. Gerstein,et al.  A Bayesian Networks Approach for Predicting Protein-Protein Interactions from Genomic Data , 2003, Science.

[17]  Aihua Li,et al.  Fast and Accurate Mining the Community Structure: Integrating Center Locating and Membership Optimization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[18]  Charles X. Ling,et al.  Using AUC and accuracy in evaluating learning algorithms , 2005, IEEE Transactions on Knowledge and Data Engineering.

[19]  Jian K. Liu,et al.  Learning Rule of Homeostatic Synaptic Scaling: Presynaptic Dependent or Not , 2011, Neural Computation.

[20]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[21]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[22]  Sheng Wang,et al.  Binary Compressive Sensing via Sum of l1-Norm and l(infinity)-Norm Regularization , 2013, MILCOM 2013 - 2013 IEEE Military Communications Conference.

[23]  H. Sompolinsky,et al.  Compressed sensing, sparsity, and dimensionality in neuronal information processing and data analysis. , 2012, Annual review of neuroscience.

[24]  M. Nowak.  Five Rules for the Evolution of Cooperation , 2006, Science.

[25]  Albert-László Barabási,et al.  Controllability of complex networks , 2011, Nature.

[26]  Stefano Panzeri,et al.  Inference of neuronal functional circuitry with spike-triggered non-negative matrix factorization , 2017, Nature Communications.

[27]  Marc Timme,et al.  Inferring network topology from complex dynamics , 2010, 1007.1640.

[28]  Amr Ahmed,et al.  Recovering time-varying networks of dependencies in social and biological studies , 2009, Proceedings of the National Academy of Sciences.

[29]  J Kurths,et al.  Inner composition alignment for inferring directed networks from short time series. , 2011, Physical review letters.

[30]  Xiao Han,et al.  Robust Reconstruction of Complex Networks from Sparse Data , 2015, Physical review letters.

[31]  Junan Lu,et al.  Recovering Structures of Complex Dynamical Networks Based on Generalized Outer Synchronization , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[32]  Guanrong Chen,et al.  Compressive-Sensing-Based Structure Identification for Multilayer Networks , 2018, IEEE Transactions on Cybernetics.

[33]  Elena Agliari,et al.  Multitasking associative networks. , 2011, Physical review letters.

[34]  William S. Yamamoto,et al.  AY's Neuroanatomy of C. elegans for Computation , 1992 .

[35]  M. Nowak,et al.  Evolutionary games and spatial chaos , 1992, Nature.

[36]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[37]  Alexander Olshevsky,et al.  Minimal Controllability Problems , 2013, IEEE Transactions on Control of Network Systems.

[38]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[39]  Neo D. Martinez,et al.  Food-web structure and network theory: The role of connectance and size , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Lihua Xie,et al.  Network Topology and Communication Data Rate for Consensusability of Discrete-Time Multi-Agent Systems , 2011, IEEE Transactions on Automatic Control.

[41]  Mahdi Jalili,et al.  Cascading Failure Tolerance of Modular Small-World Networks , 2011, IEEE Transactions on Circuits and Systems II: Express Briefs.

[42]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[43]  Wenxing Zhu,et al.  Homotopy Methods Based on $l_{0}$ -Norm for Compressed Sensing , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Wenwu Yu,et al.  Synchronization on Complex Networks of Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[45]  M. Perc.  Evolution of cooperation on scale-free networks subject to error and attack , 2009, 0902.4661.

[46]  Junan Lu,et al.  Structure identification of uncertain general complex dynamical networks with time delay , 2009, Autom..

[47]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[48]  M. Perc.  Stochastic resonance on excitable small-world networks via a pacemaker. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Marc Timme,et al.  Impact of network topology on synchrony of oscillatory power grids. , 2013, Chaos.

[50]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.

[51]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[52]  Pradumn Kumar Pandey,et al.  A Parametric Model Approach for Structural Reconstruction of Scale-Free Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[53]  Florian Dörfler,et al.  Attack Detection and Identification in Cyber-Physical Systems -- Part II: Centralized and Distributed Monitor Design , 2012, ArXiv.

[54]  Guanrong Chen,et al.  Detecting the topologies of complex networks with stochastic perturbations. , 2011, Chaos.

[55]  Dean V Buonomano,et al.  Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner , 2009, The Journal of Neuroscience.

[56]  Lida Xu,et al.  Compressed Sensing Signal and Data Acquisition in Wireless Sensor Networks and Internet of Things , 2013, IEEE Transactions on Industrial Informatics.

[57]  Adriano Barra,et al.  Extensive parallel processing on scale-free networks. , 2014, Physical review letters.