Understanding Information Transmission in Complex Networks

Information Theory concepts and methodologies conform the background of how communication systems are studied and understood. They are mainly focused on the source-channel-receiver problem and on the asymptotic limits of accuracy and communication rates, which are the classical problems studied by Shannon. However, the impact of Information Theory on networks (acting as the channel) is just starting. Here, we present an approach to understand how information flows in any connected complex network. Our approach is based on defining linear conservative flows that travel through the network from source to receiver. This framework allows us to have an analytical description of the problem and also linking the topological invariants of the network, such as the node degree, with the information flow. In particular, our approach is able to deal with information transmission in modular networks (networks containing community structures) or multiplex networks (networks with multiple layers), which are nowadays of paramount importance.

[1]  Ying-Cheng Lai,et al.  Abnormal cascading on complex networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Sakshi Pahwa,et al.  Abruptness of Cascade Failures in Power Grids , 2014, Scientific Reports.

[3]  Celso Grebogi,et al.  Structure and function in flow networks , 2013, ArXiv.

[4]  Chris Arney Sync: The Emerging Science of Spontaneous Order , 2007 .

[5]  F. Göbel,et al.  Random walks on graphs , 1974 .

[6]  Benjamin Schrauwen,et al.  Optoelectronic Reservoir Computing , 2011, Scientific Reports.

[7]  P. Tetali Random walks and the effective resistance of networks , 1991 .

[8]  Benjamin Schrauwen,et al.  Memory in linear recurrent neural networks in continuous time , 2010, Neural Networks.

[9]  Celso Grebogi,et al.  Resiliently evolving supply-demand networks. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[11]  W. Marsden I and J , 2012 .

[12]  E Bianco-Martinez,et al.  Successful network inference from time-series data using mutual information rate. , 2016, Chaos.

[13]  L. Asz Random Walks on Graphs: a Survey , 2022 .

[14]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Harry Eugene Stanley,et al.  Catastrophic cascade of failures in interdependent networks , 2009, Nature.

[16]  Peter G. Doyle,et al.  Random Walks and Electric Networks: REFERENCES , 1987 .