SDARE: A stacked denoising autoencoder method for game dynamics network structure reconstruction

Complex network is a general model to represent the interactions within technological, social, information, and biological interaction. Often, the direct detection of the interaction relationship is costly. Thus, network structure reconstruction, the inverse problem in complex networked systems, is of utmost importance for understanding many complex systems with unknown interaction structures. In addition, the data collected from real network system is often contaminated by noise, which makes the network structure inference task much more challenging. In this paper, we develop a new framework for the game dynamics network structure reconstruction based on deep learning method. In contrast to the compressive sensing methods that employ computationally complex convex/greedy algorithms to solve the network reconstruction task, we introduce a deep learning framework that can learn a structured representation from nodes data and efficiently reconstruct the game dynamics network structure with few observation data. Specifically, we propose the denoising autoencoders (DAEs) as the unsupervised feature learner to capture statistical dependencies between different nodes. Compared to the compressive sensing based method, the proposed method is a global network structure inference method, which can not only get the state-of-art performance, but also obtain the structure of network directly. Besides, the proposed method is robust to noise in the observation data. Moreover, the proposed method is also effective for the network which is not exactly sparse. Accordingly, the proposed method can extend to a wide scope of network reconstruction task in practice.

[1]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[2]  Chi Guo,et al.  Recovering network topologies via Taylor expansion and compressive sensing. , 2015, Chaos.

[3]  Chunhua Yang,et al.  Understanding cooperative behavior of agents with heterogeneous perceptions in dynamic networks , 2018, Physica A: Statistical Mechanics and its Applications.

[4]  Chunhua Yang,et al.  Effects of external forcing on evolutionary games in complex networks. , 2018, Chaos.

[5]  Aihua Li,et al.  Fast and Accurate Mining the Community Structure: Integrating Center Locating and Membership Optimization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[6]  Junan Lu,et al.  Identifying Topologies of Complex Dynamical Networks With Stochastic Perturbations , 2016, IEEE Transactions on Control of Network Systems.

[7]  Richard G. Baraniuk,et al.  A deep learning approach to structured signal recovery , 2015, 2015 53rd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Pinyi Ren,et al.  Epidemic Information Dissemination in Mobile Social Networks With Opportunistic Links , 2015, IEEE Transactions on Emerging Topics in Computing.

[11]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[12]  Jieping Ye,et al.  Network Reconstruction Based on Evolutionary-Game Data via Compressive Sensing , 2011, Physical Review X.

[13]  Yu Mao,et al.  Identification and monitoring of biological neural network , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[14]  Z. Wang,et al.  The structure and dynamics of multilayer networks , 2014, Physics Reports.

[15]  Michael Doebeli,et al.  Spatial structure often inhibits the evolution of cooperation in the snowdrift game , 2004, Nature.

[16]  Dapeng Wu,et al.  Stationary-sparse causality network learning , 2013, J. Mach. Learn. Res..

[17]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[18]  Attila Szolnoki,et al.  Evolutionary dynamics of group interactions on structured populations: a review , 2013, Journal of The Royal Society Interface.

[19]  Xiao Han,et al.  Robust Reconstruction of Complex Networks from Sparse Data , 2015, Physical review letters.

[20]  James P. Crutchfield,et al.  Geometry from a Time Series , 1980 .

[21]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[22]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[23]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Guanrong Chen,et al.  Compressive-Sensing-Based Structure Identification for Multilayer Networks , 2018, IEEE Transactions on Cybernetics.

[25]  Mike E. Davies,et al.  Iterative Hard Thresholding for Compressed Sensing , 2008, ArXiv.

[26]  Diego di Bernardo,et al.  Inference of gene regulatory networks and compound mode of action from time course gene expression profiles , 2006, Bioinform..

[27]  Jinde Cao,et al.  Local Synchronization of a Complex Network Model , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Attila Szolnoki,et al.  Coevolutionary Games - A Mini Review , 2009, Biosyst..

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  Lei Yu,et al.  Block-sparsity recovery via recurrent neural network , 2019, Signal Process..

[33]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[34]  Chunhua Yang,et al.  Swarm intelligence inspired cooperation promotion and symmetry breaking in interdependent networked game. , 2019, Chaos.

[35]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[36]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  T. Sauer,et al.  Reconstructing the topology of sparsely connected dynamical networks. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[39]  Matjaz Perc,et al.  Collective behavior and evolutionary games - An introduction , 2013, 1306.2296.

[40]  F. C. Santos,et al.  Scale-free networks provide a unifying framework for the emergence of cooperation. , 2005, Physical review letters.

[41]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[42]  M. Perc,et al.  Social diversity and promotion of cooperation in the spatial prisoner's dilemma game. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[43]  Jun Tanimoto,et al.  Network reciprocity by coexisting learning and teaching strategies. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[44]  V. Latora,et al.  Complex networks: Structure and dynamics , 2006 .

[45]  Lin Wang,et al.  Characterizing the dynamics underlying global spread of epidemics , 2018, Nature Communications.

[46]  Sheng Wang,et al.  Binary Compressive Sensing via Sum of l1-Norm and l(infinity)-Norm Regularization , 2013, MILCOM 2013 - 2013 IEEE Military Communications Conference.

[47]  G. Szabó,et al.  Evolutionary games on graphs , 2006, cond-mat/0607344.

[48]  Keke Huang,et al.  Incorporating Latent Constraints to Enhance Inference of Network Structure , 2020, IEEE Transactions on Network Science and Engineering.

[49]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[50]  Wen-Xu Wang,et al.  Reconstructing propagation networks with natural diversity and identifying hidden sources , 2014, Nature Communications.

[51]  Jordan B. Pollack,et al.  Gene Regulatory Network Evolution Through Augmenting Topologies , 2015, IEEE Transactions on Evolutionary Computation.