Transition to congestion in communication/computation networks for near-optimal and sub-optimal resource management via Monte Carlo simulations

We generalize previous studies on critical phenomena in communication networks by adding computational capabilities to the nodes to better describe real-world situations such as cloud computing. A set of tasks with random origins and destinations characterized by a multi-tier computational structure is distributed on a network modeled as a graph. The distribution of execution times (or latencies) of all tasks is statically computed for several initial workloads and its sum is used as the target function to be optimized by Simulated Annealing. A canonical Monte Carlo simulation allows to analyze the network behavior at different levels of sub-optimality of resource management (achieved by changing the temperature). We first study the static transition to congestion of the whole network by varying temperature and workload. Then, we propose a method to approximately recover the evolution of the system in time, by interpolating the static latency probability distributions. This allows to study the dynamic transition to the congested phase by introducing a variable task-production rate, as usually studied in the literature, without the need of explicit time-consuming simulations. We are able to reproduce the main published results on network congestion and to gain a deeper insight over the maximum theoretical performance of a system and its sensitivity to sub-optimality of routing and load balancing.

[1]  Martin Raab,et al.  "Balls into Bins" - A Simple and Tight Analysis , 1998, RANDOM.

[2]  Xiaofeng Gong,et al.  Optimal resource allocation for efficient transport on complex networks , 2008 .

[3]  Hai Le Vu,et al.  A strategic timing of arrivals to a linear slowdown processor sharing system , 2016, Eur. J. Oper. Res..

[4]  César A. Hidalgo,et al.  Scale-free networks , 2008, Scholarpedia.

[5]  Dzmitry Kliazovich,et al.  DENS: Data Center Energy-Efficient Network-Aware Scheduling , 2010, GreenCom/CPSCom.

[6]  Yin Zhang,et al.  On selfish routing in internet-like environments , 2006, TNET.

[7]  F. Paganini,et al.  A Unified Approach to Congestion Control and Node-Based Multipath Routing , 2009, IEEE/ACM Transactions on Networking.

[8]  A. Barabasi,et al.  Scale-free characteristics of random networks: the topology of the world-wide web , 2000 .

[9]  Sergey N. Dorogovtsev,et al.  Critical phenomena in complex networks , 2007, ArXiv.

[10]  Yoni Nazarathy,et al.  Scheduling for a processor sharing system with linear slowdown , 2015, Math. Methods Oper. Res..

[11]  Cuesta,et al.  Phase transitions in two-dimensional traffic-flow models. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[12]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[13]  G. J. Rodgers,et al.  Transport on Complex Networks: Flow, Jamming and Optimization , 2007, Int. J. Bifurc. Chaos.

[14]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[15]  Steven H. Low,et al.  Optimization flow control—I: basic algorithm and convergence , 1999, TNET.

[16]  Xiao Fan Wang,et al.  Effects of network structure and routing strategy on network capacity. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Devavrat Shah,et al.  Fastpass: a centralized "zero-queue" datacenter network , 2015, SIGCOMM 2015.

[18]  Jonathan M. Pitts,et al.  Phase Transitions in Packet Traffic on Regular Networks: a comparison of source types and topologies , 2004 .

[19]  Yong Yu,et al.  Optimal routing on complex networks , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  Nong Ye,et al.  Onset of traffic congestion in complex networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Albert-László Barabási,et al.  Scale-Free Networks: A Decade and Beyond , 2009, Science.

[22]  Yudong Sun,et al.  Collectively optimal routing for congested traffic limited by link capacity. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Ricard V. Solé,et al.  Phase Transitions in a Model of Internet Traffic , 2000 .

[24]  G. Bianconi Statistical mechanics of multiplex networks: entropy and overlap. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Toru Ohira,et al.  PHASE TRANSITION IN A COMPUTER NETWORK TRAFFIC MODEL , 1998 .