Analyses and applications of optimization methods for complex network reconstruction

Abstract Inferring the topology of a network from observable dynamics is a key topic in the research of complex network. With the observation error considered, the topology inferring is formulated as a connectivity reconstruction problem that can be solved through optimization estimation. It is found that the different optimization methods should be selected to deal with the different degrees of noise, different scales of observable time series and such other situations when it comes to the problem of connectivity reconstruction, which has not been analyzed and discussed before yet. In this paper, four regression methods, namely least squares, ridge, lasso and elastic net, are used to solve the problem of network reconstruction in different situations. In particular, a further analysis is made of the effects of each regression method on the network reconstruction problem in detail. Through simulation of a variety of artificial and real networks, as it has turned out, the four regression methods are effective in respect to network reconstruction when certain conditions are respectively satisfied. Based on the experimental results, it is possible to reach some interesting conclusions that can guide our readers to know the internal mechanisms for network reconstruction and choose the appropriate regression method in accordance with the actual situation and existing knowledge.

[1]  Haipeng Peng,et al.  Reconstruction of Complex Network based on the Noise via QR Decomposition and Compressed Sensing , 2017, Scientific Reports.

[2]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[3]  Pradumn Kumar Pandey,et al.  A Parametric Model Approach for Structural Reconstruction of Scale-Free Networks , 2017, IEEE Transactions on Knowledge and Data Engineering.

[4]  Pradumn Kumar Pandey,et al.  Reconstruction of network topology using status-time-series data , 2018 .

[5]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[6]  Shahin Shahrampour,et al.  Topology Identification of Directed Dynamical Networks via Power Spectral Analysis , 2013, IEEE Transactions on Automatic Control.

[7]  Marc Timme,et al.  Inferring network topology from complex dynamics , 2010, 1007.1640.

[8]  Chunhua Yang,et al.  Effect of clustering property on complex network reconstruction via compressed sensing , 2019, Physica A: Statistical Mechanics and its Applications.

[9]  Wen-Xu Wang,et al.  Time-series–based prediction of complex oscillator networks via compressive sensing , 2011 .

[10]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[11]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[12]  Xiao Han,et al.  Robust Reconstruction of Complex Networks from Sparse Data , 2015, Physical review letters.

[13]  F. Radicchi,et al.  Benchmark graphs for testing community detection algorithms. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[15]  Junan Lu,et al.  Recovering Structures of Complex Dynamical Networks Based on Generalized Outer Synchronization , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[16]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[17]  Jieping Ye,et al.  Network Reconstruction Based on Evolutionary-Game Data via Compressive Sensing , 2011, Physical Review X.

[18]  Ying-Cheng Lai,et al.  Statistical inference approach to structural reconstruction of complex networks from binary time series. , 2018, Physical review. E.

[19]  Ying-Cheng Lai,et al.  Reconstructing complex networks without time series. , 2017, Physical review. E.

[20]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[22]  W. Zachary,et al.  An Information Flow Model for Conflict and Fission in Small Groups , 1977, Journal of Anthropological Research.

[23]  Carolyn J. Anderson,et al.  A p* primer: logit models for social networks , 1999, Soc. Networks.

[24]  Jens Timmer,et al.  Reconstructing gene-regulatory networks from time series, knock-out data, and prior knowledge , 2007, BMC Systems Biology.

[25]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[26]  Francesco Alderisio,et al.  Reconstructing the structure of directed and weighted networks of nonlinear oscillators. , 2017, Physical review. E.

[27]  Hod Lipson,et al.  Automated reverse engineering of nonlinear dynamical systems , 2007, Proceedings of the National Academy of Sciences.

[28]  Fabrice Rossi,et al.  A statistical network analysis of the HIV/AIDS epidemics in Cuba , 2014, Social Network Analysis and Mining.

[29]  J. Collins,et al.  Inferring Genetic Networks and Identifying Compound Mode of Action via Expression Profiling , 2003, Science.

[30]  Leon O. Chua,et al.  Conditions for impulsive Synchronization of Chaotic and hyperchaotic Systems , 2001, Int. J. Bifurc. Chaos.

[31]  X. Rong Li,et al.  A two-stage algorithm for network reconstruction , 2018, Appl. Soft Comput..

[32]  A. Guhl,et al.  Social behavior of the domestic fowl. , 1968, Transactions of the Kansas Academy of Science. Kansas Academy of Science.

[33]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[34]  B. Bollobás.  The evolution of random graphs , 1984 .

[35]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[36]  Y. Lai,et al.  Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems , 2016, 1704.08764.

[37]  Mehran Mesbahi,et al.  Network identification via node knock-out , 2010, 49th IEEE Conference on Decision and Control (CDC).

[38]  D. Lusseau,et al.  The bottlenose dolphin community of Doubtful Sound features a large proportion of long-lasting associations , 2003, Behavioral Ecology and Sociobiology.

[39]  M. Newman,et al.  Finding community structure in networks using the eigenvectors of matrices. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  Marc Timme,et al.  Does Dynamics Reflect Topology in Directed Networks , 2006, cond-mat/0610186.

[41]  M. Kanat Camlibel,et al.  Topology Reconstruction of Dynamical Networks via Constrained Lyapunov Equations , 2017, IEEE Transactions on Automatic Control.

[42]  Jing Liu,et al.  Network reconstruction based on time series via memetic algorithm , 2019, Knowl. Based Syst..

[43]  M. Hénon,et al.  A two-dimensional mapping with a strange attractor , 1976 .

[44]  Nathan Linial,et al.  Generative probabilistic models for protein–protein interaction networks—the biclique perspective , 2011, Bioinform..

[45]  Ying-Cheng Lai,et al.  Universal data-based method for reconstructing complex networks with binary-state dynamics. , 2015, Physical review. E.