Inferring Network Structure and Estimating Dynamical Process From Binary-State Data via Logistic Regression

Inferring the structures and the dynamics of the complex networked systems based on time series data is a challenging problem. The existing reconstruction methods often rely on the knowledge of the dynamics on networks. In many cases, a prior knowledge of the dynamics is unknown, so it is natural to ask: is it possible to reconstruct network and estimate the dynamical processes on complex networks only rely on the observed data? In this article, we develop a framework to reconstruct the structures of networks with binary-state dynamics, in which the knowledge of the original dynamical processes is unknown. Within the reconstruction framework, the transition probabilities of binary dynamical processes are described by the Sigmoid function in logistic regression, we then apply the mean-field approximation to enable maximum likelihood estimation (MLE), which gives rise to that the network structure can be inferred by solving the linear system of equations. Meanwhile, the original dynamical processes can be simulated by estimating the parameters in the Sigmoid function. Our framework has been validated by a variety of binary dynamical processes on synthetic and empirical networks, indicating that our method can not only reveal the network structures but also estimate the dynamical processes. Moreover, the high accuracy of our method is highlighted by comparing it with the existing methods.

[1]  Wen-Xu Wang,et al.  Time-series–based prediction of complex oscillator networks via compressive sensing , 2011 .

[2]  Zongze Wu,et al.  Event-Based Synchronization of Heterogeneous Complex Networks Subject to Transmission Delays , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Xiaoqun Wu,et al.  Infection-Probability-Dependent Interlayer Interaction Propagation Processes in Multiplex Networks , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Ljupco Kocarev,et al.  Estimating topology of networks. , 2006, Physical review letters.

[5]  Guanghui Wen,et al.  Finite-Time Bipartite Consensus for Multi-Agent Systems on Directed Signed Networks , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[7]  Yifei Yuan,et al.  Scalable Influence Maximization in Social Networks under the Linear Threshold Model , 2010, 2010 IEEE International Conference on Data Mining.

[8]  Juan Liu,et al.  Robust Reconstruction of Continuously Time-Varying Topologies of Weighted Networks , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[9]  Peijun Wang,et al.  Synchronization of Resilient Complex Networks Under Attacks , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Balasubramaniam Natarajan,et al.  Epidemic Threshold of an SIS Model in Dynamic Switching Networks , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  S. Strogatz,et al.  Linguistics: Modelling the dynamics of language death , 2003, Nature.

[12]  Alan Kirman,et al.  Ants, Rationality, and Recruitment , 1993 .

[13]  Wen-Xu Wang,et al.  Reconstructing propagation networks with natural diversity and identifying hidden sources , 2014, Nature Communications.

[14]  Ying-Cheng Lai,et al.  Statistical inference approach to structural reconstruction of complex networks from binary time series. , 2018, Physical review. E.

[15]  Jieping Ye,et al.  Network Reconstruction Based on Evolutionary-Game Data via Compressive Sensing , 2011, Physical Review X.

[16]  Qipeng Liu,et al.  Competitiveness Maximization on Complex Networks , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Aneta Stefanovska,et al.  Inference of time-evolving coupled dynamical systems in the presence of noise. , 2012, Physical review letters.

[18]  M. Timme,et al.  Revealing networks from dynamics: an introduction , 2014, 1408.2963.

[19]  Junan Lu,et al.  Recovering Structures of Complex Dynamical Networks Based on Generalized Outer Synchronization , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  Erik M. Bollt,et al.  Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings , 2014, 1504.03769.

[21]  Dane Taylor,et al.  Causal Network Inference by Optimal Causation Entropy , 2014, SIAM J. Appl. Dyn. Syst..

[22]  Guanrong Chen,et al.  Detecting the topologies of complex networks with stochastic perturbations. , 2011, Chaos.

[23]  G. Cecchi,et al.  Scale-free brain functional networks. , 2003, Physical review letters.

[24]  Daizhan Cheng,et al.  Modeling, Analysis and Control of Networked Evolutionary Games , 2015, IEEE Transactions on Automatic Control.

[25]  Haifeng Zhang,et al.  Critical noise of majority-vote model on complex networks. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  Bing-Bing Xiang,et al.  Reconstructing signed networks via Ising dynamics. , 2018, Chaos.

[27]  Ying-Cheng Lai,et al.  Sparse dynamical Boltzmann machine for reconstructing complex networks with binary dynamics. , 2018, Physical review. E.

[28]  Y. Lai,et al.  Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems , 2016, 1704.08764.

[29]  J. Gleeson Binary-state dynamics on complex networks: pair approximation and beyond , 2012, 1209.2983.

[30]  S. Redner,et al.  Voter model on heterogeneous graphs. , 2004, Physical review letters.

[31]  Jin Zhou,et al.  Identifying partial topology of complex dynamical networks via a pinning mechanism. , 2018, Chaos.

[32]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[33]  Karl J. Friston,et al.  Bayesian Estimation of Dynamical Systems: An Application to fMRI , 2002, NeuroImage.

[34]  E. Bullmore,et al.  Adaptive reconfiguration of fractal small-world human brain functional networks , 2006, Proceedings of the National Academy of Sciences.

[35]  Guanghui Wen,et al.  Complex cyber-physical networks: From cybersecurity to security control , 2017, J. Syst. Sci. Complex..

[36]  S. Redner,et al.  A Kinetic View of Statistical Physics , 2010 .

[37]  M. Newman,et al.  Renormalization Group Analysis of the Small-World Network Model , 1999, cond-mat/9903357.

[38]  Wen-Xu Wang,et al.  Noise bridges dynamical correlation and topology in coupled oscillator networks. , 2010, Physical review letters.

[39]  Fang Xu,et al.  Reconstructing of Networks With Binary-State Dynamics via Generalized Statistical Inference , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[40]  Javad Zahiri,et al.  Gene co-expression network reconstruction: a review on computational methods for inferring functional information from plant-based expression data , 2017, Plant Biotechnology Reports.

[41]  Xiaoqun Wu,et al.  Topology Identification in Two-Layer Complex Dynamical Networks , 2020, IEEE Transactions on Network Science and Engineering.

[42]  Michael I. Jordan,et al.  Mean Field Theory for Sigmoid Belief Networks , 1996, J. Artif. Intell. Res..

[43]  Subhadeep Chakraborty,et al.  Dynamics of a Repulsive Voter Model , 2015, IEEE Transactions on Computational Social Systems.

[44]  Marc Timme,et al.  Revealing network connectivity from response dynamics. , 2006, Physical review letters.

[45]  Claire J. Tomlin,et al.  Exact reconstruction of gene regulatory networks using compressive sensing , 2014, BMC Bioinformatics.

[46]  Xun Li,et al.  Reconstruction of stochastic temporal networks through diffusive arrival times , 2017, Nature Communications.

[47]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[48]  Pei Wang,et al.  Exploring transcription factors reveals crucial members and regulatory networks involved in different abiotic stresses in Brassica napus L. , 2018, BMC Plant Biology.