Budget-Optimized Network-Aware Joint Resource Allocation in Grids/Clouds Over Optical Networks

Resource allocation is an important component of many Cloud computing and datacenter management problems. For infrastructure as a service(IaaS) in the Cloud, the Cloud service provider allocates computing resources such as processor, memory, and storage. In addition to the computing infrastructures, the Cloud service provider in the future would also allocate bandwidth for some applications that require guaranteed bandwidth service to transmit a large amount of data. This type of guaranteed bandwidth service can be provided by provisioning a distinct connection from end-to-end, e.g., by provisioning wavelength(s) in a wavelength division multiplexed wavelength routed network. In this paper, we focus on interdatacenter network-aware optimal resource allocation in the Cloud from the customer's perspective. We develop a mixed integer linear programming (MILP) optimal mathematical model and heuristics (Best-Fit and Tabu search) to solve the budget optimized joint-resource allocation problem to minimize the rental cost for each customer. The experimental results show that our heuristics can achieve an approximate optimal solution to the MILP solution and can reduce the customer's rental cost by at least 30%. The Best-Fit heuristic with shortest job execution time first and simplest job structure first (SSF) scheduling policies have a better performance in terms of the traffic blocking rate. The traffic blocking rates under both scheduling policies are 5-25% less than other policies. The Tabu search-based heuristic with SSF job scheduling policy has a better performance in terms of the traffic blocking rate than other job scheduling policies. In addition, the Tabu search-based heuristic also reduces the blocking rate by 4-30% compared with the Best-Fit heuristic under any job scheduling policy.

[1]  Byrav Ramamurthy,et al.  Continuous and Parallel Optimization of Dynamic Bandwidth Scheduling in WDM Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[2]  Keith Decker,et al.  Flexible Grid Workflows Using TÆMS , 2005 .

[3]  Erik Elmroth,et al.  Autonomic Resource Allocation for Cloud Data Centers: A Peer to Peer Approach , 2014, 2014 International Conference on Cloud and Autonomic Computing.

[4]  T. V. Lakshman,et al.  Network aware resource allocation in distributed clouds , 2012, 2012 Proceedings IEEE INFOCOM.

[5]  Byrav Ramamurthy,et al.  Budget-Minimized Resource Allocation and Task Scheduling in Distributed Grid/Clouds , 2013, 2013 22nd International Conference on Computer Communication and Networks (ICCCN).

[6]  Byrav Ramamurthy,et al.  A Tabu search based heuristic for optimized joint resource allocation and task scheduling in Grid/Clouds , 2013, 2013 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS).

[7]  Daniel Grosu,et al.  Truthful Greedy Mechanisms for Dynamic Virtual Machine Provisioning and Allocation in Clouds , 2015, IEEE Transactions on Parallel and Distributed Systems.

[8]  Byrav Ramamurthy,et al.  Cost-optimized joint resource allocation in grids/clouds with multilayer optical network architecture , 2014, IEEE/OSA Journal of Optical Communications and Networking.

[9]  Taisir E. H. El-Gorashi,et al.  Energy Efficient Virtual Network Embedding for Cloud Networks , 2015, Journal of Lightwave Technology.

[10]  Yuefeng Ji,et al.  Experimental Demonstration of Datacenter Resources Integrated Provisioning Over Multi-Domain Software Defined Optical Networks , 2015, Journal of Lightwave Technology.

[11]  Dong Shen,et al.  On multiplexing optimization in DWDM networks , 2011, 2011 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference.

[12]  Steven R. Simon,et al.  The CMS online cluster: IT for a large data acquisition and control cluster , 2010 .

[13]  Santosh Krishnan,et al.  Google Compute Engine , 2015 .

[14]  Radoslaw Hofman,et al.  Why LP Cannot Solve Large Instances of NP-complete Problems in Polynomial Time , 2006, IMECS.

[15]  Jyh-Horng Chou,et al.  Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm , 2013, Comput. Oper. Res..

[16]  Zhiwu Huang,et al.  Dynamic resource reservation via broker federation in cloud service: A fine-grained heuristic-based approach , 2014, 2014 IEEE Global Communications Conference.

[17]  Meng Liu,et al.  A Decentralized Cloud Firewall Framework with Resources Provisioning Cost Optimization , 2015, IEEE Transactions on Parallel and Distributed Systems.

[18]  Gabriele Garzoglio,et al.  Open Science Grid , 2011 .

[19]  Byrav Ramamurthy,et al.  Provisioning virtualized cloud services in IP/MPLS-over-EON Networks , 2015, ONDM.

[20]  Baochun Li,et al.  Dynamic Cloud Resource Reservation via Cloud Brokerage , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[21]  Samiran Chattopadhyay,et al.  Resource allocation in cloud using simulated annealing , 2014, 2014 Applications and Innovations in Mobile Computing (AIMoC).

[22]  Roberto Proietti,et al.  Adaptive Spectrum Control and Management in Elastic Optical Networks , 2013, IEEE Journal on Selected Areas in Communications.

[23]  George N. Rouskas,et al.  Efficient resource management using advance reservations for heterogeneous Grids , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[24]  Byrav Ramamurthy,et al.  Next-Generation Internet Architectures and Protocols: Grid networking , 2011 .

[25]  Judith Kelner,et al.  Resource allocation for distributed cloud: concepts and research challenges , 2011, IEEE Network.

[26]  Maarten van Steen,et al.  Cost-Effective Resource Allocation for Deploying Pub/Sub on Cloud , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[27]  Judith Kelner,et al.  D-CRAS: Distributed cloud resource allocation system , 2012, 2012 IEEE Network Operations and Management Symposium.

[28]  Neal Charbonneau,et al.  A Survey of Advance Reservation Routing and Wavelength Assignment in Wavelength-Routed WDM Networks , 2012, IEEE Communications Surveys & Tutorials.