Entropy Maximization as a Holistic Design Principle for Complex Optimal Networks and the Emergence of Power Laws

We present a general holistic theory for the organization of complex networks, both human-engineered and naturally-evolved. Introducing concepts of value of interactions and satisfaction as generic network performance measures, we show that the underlying organizing principle is to meet an overall performance target for wide-ranging operating or environmental conditions. This design or survival requirement of reliable performance under uncertainty leads, via the maximum entropy principle, to the emergence of a power law vertex degree distribution. The theory also predicts exponential or Poisson degree distributions depending on network redundancy, thus explaining all three regimes as different manifestations of a common underlying phenomenon within a unified theoretical framework.

[1]  Béla Bollobás,et al.  Random Graphs , 1985 .

[2]  Stefano Mossa,et al.  Truncation of power law behavior in "scale-free" network models due to information filtering. , 2002, Physical review letters.

[3]  Alexandre Arenas,et al.  Optimal network topologies for local search with congestion , 2002, Physical review letters.

[4]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[5]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[6]  Julio M. Ottino,et al.  New tools, new outlooks, new opportunities† , 2005 .

[7]  Albert-László Barabási,et al.  Statistical mechanics of complex networks , 2001, ArXiv.

[8]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[9]  Roger Guimerà,et al.  Robust patterns in food web structure. , 2001, Physical review letters.

[10]  Doyle,et al.  Highly optimized tolerance: robustness and design in complex systems , 2000, Physical review letters.

[11]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[12]  Mark Buchanan Wealth happens. , 2002, Harvard business review.

[13]  R. Albert,et al.  The large-scale organization of metabolic networks , 2000, Nature.

[14]  R. Ferrer i Cancho,et al.  Scale-free networks from optimal design , 2002, cond-mat/0204344.

[15]  Michelle Girvan,et al.  Optimal design, robustness, and risk aversion. , 2002, Physical review letters.

[16]  Venkat Venkatasubramanian,et al.  Spontaneous emergence of complex optimal networks through evolutionary adaptation , 2004, Comput. Chem. Eng..

[17]  Dennis Gabor,et al.  Theory of communication , 1946 .

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  C. Handy,et al.  What's a business for? , 2002, Harvard business review.

[20]  J. M. Ottino,et al.  Engineering complex systems , 2004, Nature.

[21]  H E Stanley,et al.  Classes of small-world networks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.