Uncovering Hidden Dependency in Weighted Networks via Information Entropy

Interactions between elements, which are usually represented by networks, have to delineate potentially unequal relationships in terms of their relative importance or direction. The intrinsic unequal relationships of such kind, however, are opaque or hidden in numerous real systems. For instance, when a node in a network with limited interaction capacity spends its capacity to its neighboring nodes, the allocation of the total amount of interactions to them can be vastly diverse. Even if such potentially heterogeneous interactions epitomized by weighted networks are observable, as a result of the aforementioned ego-centric allocation of interactions, the relative importance or dependency between two interacting nodes can only be implicitly accessible. In this work, we precisely pinpoint such relative dependency by proposing the framework to discover hidden dependent relations extracted from weighted networks. For a given weighted network, we provide a systematic criterion to select the most essential interactions for individual nodes based on the concept of information entropy. The criterion is symbolized by assigning the effective number of neighbors or the effective out-degree to each node, and the resultant directed subnetwork decodes the hidden dependent relations by leaving only the most essential directed interactions. We apply our methodology to two time-stamped empirical network data, namely the international trade relations between nations in the world trade web (WTW) and the network of people in the historical record of Korea, Annals of the Joseon Dynasty (AJD). Based on the data analysis, we discover that the properties of mutual dependency encoded in the two systems are vastly different.

[1]  L. Jost Entropy and diversity , 2006 .

[2]  Heiko Rieger,et al.  Random walks on complex networks. , 2004, Physical review letters.

[3]  Karol Zyczkowski,et al.  Rényi Extrapolation of Shannon Entropy , 2003, Open Syst. Inf. Dyn..

[4]  Aaron Clauset,et al.  Scale-free networks are rare , 2018, Nature Communications.

[5]  M. Hill Diversity and Evenness: A Unifying Notation and Its Consequences , 1973 .

[6]  Sergey N. Dorogovtsev,et al.  Critical phenomena in complex networks , 2007, ArXiv.

[7]  T. Pitcher Behaviour of Teleost Fishes , 1986 .

[8]  César A. Hidalgo,et al.  The building blocks of economic complexity , 2009, Proceedings of the National Academy of Sciences.

[9]  Ronald L. Graham,et al.  On the History of the Minimum Spanning Tree Problem , 1985, Annals of the History of Computing.

[10]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[11]  Jianmin Jia,et al.  Population flow drives spatio-temporal distribution of COVID-19 in China , 2020, Nature.

[12]  Sang Hoon Lee,et al.  Early onset of structural inequality in the formation of collaborative knowledge in all Wikimedia projects , 2018, Nature Human Behaviour.

[13]  Politics of Economic Growth in India , 1980-2005 Part II : The 1990 s and Beyond India , 2008 .

[14]  Daniel Kim,et al.  N-gram Web Service and Stylometric Analysis of Korean Historical Documents , 2016 .

[16]  Ginestra Bianconi,et al.  Generalized network structures: The configuration model and the canonical ensemble of simplicial complexes. , 2016, Physical review. E.

[17]  Markus K. Brunnermeier Asset Pricing under Asymmetric Information , 2001 .

[18]  Petter Holme,et al.  Modeling the dynamics of dissent , 2016, 1603.01980.

[19]  César A. Hidalgo,et al.  The Product Space Conditions the Development of Nations , 2007, Science.

[20]  G. Solt Flavor of the Month , 2014 .

[21]  C. Beck,et al.  Thermodynamics of chaotic systems : an introduction , 1993 .

[22]  Joel Best Flavor of the Month: Why Smart People Fall for Fads , 2006 .

[23]  Dmitri V. Krioukov,et al.  Scale-free Networks Well Done , 2018, Physical Review Research.

[24]  Marián Boguñá,et al.  Extracting the multiscale backbone of complex weighted networks , 2009, Proceedings of the National Academy of Sciences.

[25]  E. H. Simpson Measurement of Diversity , 1949, Nature.

[26]  Markus K. Brunnermeier Asset Pricing under Asymmetric Information: Bubbles, Crashes, Technical Analysis, and Herding , 2001 .

[27]  T. Pitcher Functions of Shoaling Behaviour in Teleosts , 1986 .

[28]  Pierre Lévy,et al.  Collective Intelligence: Mankind's Emerging World in Cyberspace , 1997 .

[29]  Yong-Yeol Ahn,et al.  The effectiveness of contact tracing in heterogeneous networks , 2020 .

[30]  Ingo Scholtes,et al.  Higher-order aggregate networks in the analysis of temporal networks: path structures and centralities , 2015, The European Physical Journal B.

[31]  M. Nowak,et al.  Evolutionary games on isothermal graphs , 2019, Nature Communications.

[32]  B. Kahng,et al.  Intrinsic degree-correlations in the static model of scale-free networks , 2006 .

[33]  M. De Domenico,et al.  Statistical physics of complex information dynamics. , 2020, Physical review. E.

[34]  Bernard Derrida,et al.  Statistical properties of randomly broken objects and of multivalley structures in disordered systems , 1987 .

[35]  Hawoong Jeong,et al.  Googling Social Interactions: Web Search Engine Based Social Network Construction , 2007, PloS one.

[36]  P. Holland,et al.  Transitivity in Structural Models of Small Groups , 1971 .

[37]  James D. Hamilton What is an Oil Shock? , 2000 .

[38]  M. Newman,et al.  Mixing patterns in networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[39]  A. Chao,et al.  Phylogenetic Diversity Measures and Their Decomposition: A Framework Based on Hill Numbers , 2016 .

[40]  A. Hirschman National Power and the Structure of Foreign Trade , 2024 .

[41]  Jean-Gabriel Young,et al.  Network archaeology: phase transition in the recoverability of network history , 2018 .

[42]  Mark Newman,et al.  Networks: An Introduction , 2010 .

[43]  Gorjan Alagic,et al.  #p , 2019, Quantum information & computation.

[44]  Martin A Nowak,et al.  Spatial dilemmas of diffusible public goods , 2013, eLife.

[45]  Jessica T Davis,et al.  The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak , 2020, Science.

[46]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[47]  M E J Newman Assortative mixing in networks. , 2002, Physical review letters.

[48]  Yong-Yeol Ahn,et al.  The effectiveness of backward contact tracing in networks , 2020, Nature Physics.

[49]  Deok-Sun Lee,et al.  Understanding the temporal pattern of spreading in heterogeneous networks: Theory of the mean infection time , 2018, Physical review. E.