Sparse Bayesian learning for network structure reconstruction based on evolutionary game data

Abstract Network structure reconstruction is a fundamental problem for understanding, predicting and controlling the behaviors of complex networked systems and has received growing attention due to the potentials in a wide range of fields. Recent years have witnessed dramatic advances in the field of network structure reconstruction, especially the famous compressed sensing-based methods. However, some neglected disadvantages still exist in the existing works, such as the high measurement correlation existing in the solution matrix, reconstruction behaviors subject to model-based constraints and pure point estimate of the reconstruction results without credibility, which inevitably drag down the reconstruction performance. To address these problems, we propose a new framework of sparse Bayesian learning for network structure reconstruction based on evolutionary game data from the perspective of Bayesian and statistics. Specifically, we formulate the problem of network structure reconstruction as a Bayesian compressed sensing problem. Then, a hierarchical prior model is invoked for conjugated Bayesian inference to obtain the posterior distribution of the reconstructed result, including the reconstructed mean and covariance. Finally, the parameters in the reconstructed results are updated by an iterative estimation procedure. Results from numerical experiments have demonstrated applicability and efficiency of the proposed method and presented superiority over other reconstruction methods.

[1]  A. Barabasi,et al.  The network takeover , 2011, Nature Physics.

[2]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[3]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[4]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[5]  F. C. Santos,et al.  A new route to the evolution of cooperation , 2006, Journal of evolutionary biology.

[6]  Jieping Ye,et al.  Network Reconstruction Based on Evolutionary-Game Data via Compressive Sensing , 2011, Physical Review X.

[7]  Bhaskar D. Rao,et al.  Sparse Signal Recovery With Temporally Correlated Source Vectors Using Sparse Bayesian Learning , 2011, IEEE Journal of Selected Topics in Signal Processing.

[8]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..

[9]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[10]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[11]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[12]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[13]  Dawei Zhao,et al.  Statistical physics of vaccination , 2016, ArXiv.

[14]  F. C. Santos,et al.  Evolutionary dynamics of social dilemmas in structured heterogeneous populations. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[15]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[16]  Ying-Cheng Lai,et al.  Reconstructing direct and indirect interactions in networked public goods game , 2016, Scientific Reports.

[17]  Chi Guo,et al.  Recovering network topologies via Taylor expansion and compressive sensing. , 2015, Chaos.

[18]  Aggelos K. Katsaggelos,et al.  Bayesian Compressive Sensing Using Laplace Priors , 2010, IEEE Transactions on Image Processing.

[19]  Bhaskar D. Rao,et al.  Latent Variable Bayesian Models for Promoting Sparsity , 2011, IEEE Transactions on Information Theory.

[20]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[21]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[22]  Charles X. Ling,et al.  Using AUC and accuracy in evaluating learning algorithms , 2005, IEEE Transactions on Knowledge and Data Engineering.

[23]  Ying-Cheng Lai,et al.  Scaling of noisy fluctuations in complex networks and applications to network prediction. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[24]  Attila Szolnoki,et al.  Statistical Physics of Human Cooperation , 2017, ArXiv.

[25]  J. Collins,et al.  Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling , 2003, Science.

[26]  Jian Song,et al.  Topology reconstruction for power line network based on Bayesian compressed sensing , 2015, 2015 IEEE International Symposium on Power Line Communications and Its Applications (ISPLC).

[27]  J. Hofbauer,et al.  Evolutionary game dynamics , 2011 .

[28]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[29]  George Tzagkarakis,et al.  Multiple-measurement Bayesian compressed sensing using GSM priors for DOA estimation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Ángel Sánchez,et al.  Evolutionary game theory: Temporal and spatial effects beyond replicator dynamics , 2009, Physics of life reviews.

[31]  André Longtin,et al.  Noise in genetic and neural networks. , 2006, Chaos.

[32]  Matjaz Perc,et al.  Statistical physics of crime: A review , 2014, Physics of life reviews.

[33]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[34]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[35]  Lutz H.-J. Lampe,et al.  Power Line Communications for Low-Voltage Power Grid Tomography , 2013 .

[36]  J Kurths,et al.  Inner composition alignment for inferring directed networks from short time series. , 2011, Physical review letters.

[37]  Reuven Cohen,et al.  Complex Networks: Structure, Robustness and Function , 2010 .

[38]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[39]  Yonina C. Eldar,et al.  Block-Sparse Signals: Uncertainty Relations and Efficient Recovery , 2009, IEEE Transactions on Signal Processing.

[40]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[41]  Wen-Xu Wang,et al.  Noise bridges dynamical correlation and topology in coupled oscillator networks. , 2010, Physical review letters.

[42]  Hong Sun,et al.  Bayesian compressive sensing for cluster structured sparse signals , 2012, Signal Process..

[43]  M. Perc Double resonance in cooperation induced by noise and network variation for an evolutionary prisoner's dilemma , 2006 .

[44]  Xiao Han,et al.  Robust Reconstruction of Complex Networks from Sparse Data , 2015, Physical review letters.

[45]  Dirk Helbing,et al.  Saving Human Lives: What Complexity Science and Information Systems can Contribute , 2014, Journal of statistical physics.

[46]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[47]  Lin Wang,et al.  Evolutionary games on multilayer networks: a colloquium , 2015, The European Physical Journal B.

[48]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[49]  Zhen Wang,et al.  Impact of Social Punishment on Cooperative Behavior in Complex Networks , 2013, Scientific Reports.

[50]  Michael B. Wakin,et al.  An Introduction To Compressive Sampling [A sensing/sampling paradigm that goes against the common knowledge in data acquisition] , 2008 .

[51]  Keke Huang,et al.  Incorporating Latent Constraints to Enhance Inference of Network Structure , 2020, IEEE Transactions on Network Science and Engineering.

[52]  Lawrence Carin,et al.  Exploiting Structure in Wavelet-Based Bayesian Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[53]  Wen-Xu Wang,et al.  Reconstructing propagation networks with natural diversity and identifying hidden sources , 2014, Nature Communications.

[54]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[55]  Jun Fang,et al.  Pattern-Coupled Sparse Bayesian Learning for Recovery of Block-Sparse Signals , 2015, IEEE Trans. Signal Process..

[56]  Jing Liu,et al.  Evolutionary Game Network Reconstruction by Memetic Algorithm with l 1/2 Regularization , 2017, SEAL.

[57]  Sean C. Warnick,et al.  Robust dynamical network reconstruction , 2010, 49th IEEE Conference on Decision and Control (CDC).

[58]  Bhaskar D. Rao,et al.  An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem , 2007, IEEE Transactions on Signal Processing.

[59]  Feng Qi,et al.  Randomness enhances cooperation: a resonance-type phenomenon in evolutionary games. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  Wen-Xu Wang,et al.  Efficient Reconstruction of Heterogeneous Networks from Time Series via Compressed Sensing , 2015, PloS one.

[61]  Wen-Xu Wang,et al.  Detecting hidden nodes in complex networks from time series. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.