Dynamic Cost-Aware Routing of Web Requests

Work within next generation networks considers additional network convergence possibilities and the integration of new services to the web. This trend responds to the ongoing growth of end-user demand for services that can be delivered anytime, anywhere, on any web-capable device, and of traffic generated by new applications, e.g., the Internet of Things. To support the massive traffic generated by the enormous user base and number of devices with reliability and high quality, web services run from redundant servers. As new servers need to be regularly deployed at different geographical locations, energy costs have become a source of major concern for operators. We propose a cost aware method for routing web requests across replicated and distributed servers that can exploit the spatial and temporal variations of both electricity prices and the server network. The method relies on a learning automaton that makes per-request decisions, which can be computed much faster than regular global optimization methods. Using simulation and testbed measurements, we show the cost reductions that are achievable with minimal impact on performance compared to standard web routing algorithms.

[1]  Athanasios V. Vasilakos,et al.  Nonlinear ergodic epsilon-optimal discretized reward-penalty learning automata and their application to adaptive routing algorithms , 1991, Neurocomputing.

[2]  Shusen Yang,et al.  Energy-efficient Geo-Distributed Big Data Analytics , 2017 .

[3]  Vijey Thayananthan,et al.  Analysis of round-robin load-balancing algorithm with adaptive and predictive approaches , 2016, 2016 UKACC 11th International Conference on Control (CONTROL).

[4]  Yong Qi,et al.  A two-time-scale load balancing framework for minimizing electricity bills of Internet Data Centers , 2016, Personal and Ubiquitous Computing.

[5]  Munam Ali Shah,et al.  Load balancing algorithms in cloud computing: A survey of modern techniques , 2015, 2015 National Software Engineering Conference (NSEC).

[6]  Naveen K. Chilamkurti,et al.  Learning Automata-based Opportunistic Data Aggregation and Forwarding scheme for alert generation in Vehicular Ad Hoc Networks , 2014, Comput. Commun..

[7]  Lachlan L. H. Andrew,et al.  Greening geographical load balancing , 2015, TNET.

[8]  Elgar Fleisch,et al.  WHAT IS THE INTERNET OF THINGS? AN ECONOMIC PERSPECTIVE , 2010 .

[9]  S Gawley,et al.  Trends and analysis , 1998 .

[10]  George Kesidis,et al.  Optimal Peak Shaving Using Batteries at Datacenters: Characterizing the Risks and Benefits , 2017, 2017 IEEE 25th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS).

[11]  Wen-De Zhong,et al.  Energy Aware Pricing in a Three-Tiered Cloud Service Market , 2016 .

[12]  Athanasios V. Vasilakos,et al.  Variable Window Flow Control and Ergodic Descretized Learning Algorithms for Adaptive Routing in Data Networks , 1991, Comput. Networks ISDN Syst..

[13]  Rajkumar Buyya,et al.  A Fuzzy Logic-Based Controller for Cost and Energy Efficient Load Balancing in Geo-distributed Data Centers , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[14]  Xue Liu,et al.  D-Pro: Dynamic Data Center Operations With Demand-Responsive Electricity Prices in Smart Grid , 2012, IEEE Transactions on Smart Grid.

[15]  Gianfranco Ciardo,et al.  EQUILOAD: a load balancing policy for clustered web servers , 2001, Perform. Evaluation.

[16]  K. S. Narendra,et al.  Nonstationary models of learning automata routing in data communication networks , 1987, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Xue Liu,et al.  Distributed Coordination of Internet Data Centers Under Multiregional Electricity Markets , 2012, Proceedings of the IEEE.

[18]  A.A. Economides,et al.  Optimal routing in a network with unreliable links , 1988, [1988] Proceedings. Computer Networking Symposium.

[19]  Kumpati S. Narendra,et al.  On the Behavior of a Learning Automaton in a Changing Environment with Application to Telephone Traffic Routing , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  Rajkumar Buyya,et al.  Renewable-aware geographical load balancing of web applications for sustainable data centers , 2017, J. Netw. Comput. Appl..

[21]  B. John Oommen,et al.  The asymptotic optimality of discretized linear reward-inaction learning automata , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[22]  Robert Shorten,et al.  Stratus: Load Balancing the Cloud for Carbon Emissions Control , 2013, IEEE Transactions on Cloud Computing.

[23]  Lachlan L. H. Andrew,et al.  Online algorithms for geographical load balancing , 2012, 2012 International Green Computing Conference (IGCC).

[24]  Nader Mohamed,et al.  A Survey of Load Balancing in Cloud Computing: Challenges and Algorithms , 2012, 2012 Second Symposium on Network Cloud Computing and Applications.

[25]  Minyi Guo,et al.  Renewable Energy-Aware Big Data Analytics in Geo-Distributed Data Centers with Reinforcement Learning , 2020, IEEE Transactions on Network Science and Engineering.

[26]  Kumpati S. Narendra,et al.  Learning Automata - A Survey , 1974, IEEE Trans. Syst. Man Cybern..

[27]  Xue Liu,et al.  Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment , 2010, 2010 Proceedings IEEE INFOCOM.

[28]  B. Johnoommen.  Absorbing and Ergodic Discretized Two-Action Learning Automata , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[29]  Lei Deng,et al.  Joint bidding and geographical load balancing for datacenters: Is uncertainty a blessing or a curse? , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[30]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[31]  Lachlan L. H. Andrew,et al.  Geographical load balancing with renewables , 2011, PERV.

[32]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[33]  B. John Oommen,et al.  Multiaction learning automata possessing ergodicity of the mean , 1985, Inf. Sci..

[34]  Lachlan L. H. Andrew,et al.  Greening Geographical Load Balancing , 2015, IEEE/ACM Transactions on Networking.

[35]  Robert Shorten,et al.  Distributed Dynamic Speed Scaling , 2010, 2010 Proceedings IEEE INFOCOM.

[36]  Amir Masoud Rahmani,et al.  Load Balancing in Cloud Computing: A State of the Art Survey , 2016 .

[37]  Alexandra Fedorova,et al.  Global cost diversity aware dispatch algorithm for heterogeneous data centers , 2011, ICPE '11.

[38]  Mehdi Hosseinzadeh,et al.  A learning automata and clustering-based routing protocol for named data networking , 2017, Telecommun. Syst..