Joint Optimization of Operational Cost and Performance Interference in Cloud Data Centers

Virtual machine (VM) scheduling is an important technique for the efficient operation of the computing resources in a data center. Previous work has mainly focused on consolidating VMs to improve resource utilization and to optimize energy consumption. However, the interference between collocated VMs is usually ignored, which can result in much worse performance degradation of the applications running on the VMs due to the contention of the shared resources. Based on this observation, we aim at designing efficient VM assignment and scheduling strategies in which we consider optimizing both the operational cost of the data center and the performance degradation of the running applications. We then propose a general model that captures the tradeoff between the two contradictory objectives. We present offline and online solutions for this problem by exploiting the spatial and temporal information of performance interference of VM collocation, where VM scheduling is performed by jointly considering the combinations and the life-cycle overlap of the VMs. Evaluation results show that the proposed methods can generate efficient schedules for VMs, achieving low operational cost while significantly reducing the performance degradation of applications in cloud data centers.

[1]  Ahmed Amokrane,et al.  Greenhead: Virtual Data Center Embedding across Distributed Infrastructures , 2013, IEEE Transactions on Cloud Computing.

[2]  H. Howie Huang,et al.  TRACON: Interference-Aware Schedulingfor Data-Intensive Applicationsin Virtualized Environments , 2011, IEEE Transactions on Parallel and Distributed Systems.

[3]  Eui-nam Huh,et al.  Cloud broker service‐oriented resource management model , 2017, Trans. Emerg. Telecommun. Technol..

[4]  Shin Gyu Kim,et al.  Virtual machine consolidation based on interference modeling , 2013, The Journal of Supercomputing.

[5]  Athanasios V. Vasilakos,et al.  Survey on routing in data centers: insights and future directions , 2011, IEEE Network.

[6]  Athanasios V. Vasilakos,et al.  Managing Performance Overhead of Virtual Machines in Cloud Computing: A Survey, State of the Art, and Future Directions , 2014, Proceedings of the IEEE.

[7]  Calton Pu,et al.  An Analysis of Performance Interference Effects in Virtual Environments , 2007, 2007 IEEE International Symposium on Performance Analysis of Systems & Software.

[8]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[9]  Magdalena Balazinska,et al.  Hadoop's Adolescence , 2013, Proc. VLDB Endow..

[10]  Eui-nam Huh,et al.  QoS degradation based reimbursement for real-time cloud communication , 2015, AWeS@EuroSys.

[11]  M. Balazinska,et al.  An analysis of Hadoop usage in scientific workloads , 2013 .

[12]  Bo Li,et al.  On arbitrating the power-performance tradeoff in SaaS clouds , 2013, 2013 Proceedings IEEE INFOCOM.

[13]  Jie Liu,et al.  PACMan: Performance Aware Virtual Machine Consolidation , 2013, ICAC.

[14]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[15]  Jan Broeckhove,et al.  Black box scheduling for resource intensive virtual machine workloads with interference models , 2013, Future Gener. Comput. Syst..

[16]  Nikhil R. Devanur,et al.  Cloud scheduling with setup cost , 2013, SPAA.

[17]  Bo Li,et al.  Submitted to Ieee Transactions on Parallel and Distributed Systems 1 on Arbitrating the Power-performance Tradeoff in Saas Clouds , 2022 .

[18]  Athanasios V. Vasilakos,et al.  Traffic-Aware Resource Provisioning for Distributed Clouds , 2015, IEEE Cloud Computing.

[19]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[20]  Jie Liu,et al.  Cuanta: quantifying effects of shared on-chip resource interference for consolidated virtual machines , 2011, SoCC.

[21]  Athanasios V. Vasilakos,et al.  A Framework for Truthful Online Auctions in Cloud Computing with Heterogeneous User Demands , 2016, IEEE Transactions on Computers.

[22]  Erik D. Demaine,et al.  Energy-Efficient Algorithms , 2016, ITCS.

[23]  Xiaolei Dong,et al.  Security and privacy for storage and computation in cloud computing , 2014, Inf. Sci..

[24]  Athanasios V. Vasilakos,et al.  GreenDCN: A General Framework for Achieving Energy Efficiency in Data Center Networks , 2013, IEEE Journal on Selected Areas in Communications.

[25]  Dario Bruneo,et al.  A Stochastic Model to Investigate Data Center Performance and QoS in IaaS Cloud Computing Systems , 2014, IEEE Transactions on Parallel and Distributed Systems.

[26]  Athanasios V. Vasilakos,et al.  Joint virtual machine assignment and traffic engineering for green data center networks , 2014, PERV.

[27]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[28]  Athanasios V. Vasilakos,et al.  SecCloud: Bridging Secure Storage and Computation in Cloud , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems Workshops.

[29]  Geoffrey C. Fox,et al.  High Performance Parallel Computing with Clouds and Cloud Technologies , 2009, CloudComp.

[30]  Athanasios V. Vasilakos,et al.  MAPCloud: Mobile Applications on an Elastic and Scalable 2-Tier Cloud Architecture , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[31]  Athanasios V. Vasilakos,et al.  Mobile Cloud Computing: A Survey, State of Art and Future Directions , 2013, Mobile Networks and Applications.

[32]  Athanasios V. Vasilakos,et al.  Incentive-Compatible Online Mechanisms for Resource Provisioning and Allocation in Clouds , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[33]  Nagarajan Kandasamy,et al.  Power and performance management of virtualized computing environments via lookahead control , 2008, 2008 International Conference on Autonomic Computing.

[34]  Athanasios V. Vasilakos,et al.  Resource and Revenue Sharing with Coalition Formation of Cloud Providers: Game Theoretic Approach , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[35]  Haiying Shen,et al.  Consolidating complementary VMs with spatial/temporal-awareness in cloud datacenters , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[36]  Karsten Schwan,et al.  VirtualPower: coordinated power management in virtualized enterprise systems , 2007, SOSP.

[37]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[38]  Athanasios V. Vasilakos,et al.  MuSIC: Mobility-Aware Optimal Service Allocation in Mobile Cloud Computing , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[39]  Kyle Chard,et al.  Social Clouds: A Retrospective , 2015, IEEE Cloud Computing.

[40]  EunYoung Lee,et al.  Task Balanced Workflow Scheduling Technique considering Task Processing Rate in Spot Market , 2014, J. Appl. Math..

[41]  Kevin Skadron,et al.  Bubble-up: Increasing utilization in modern warehouse scale computers via sensible co-locations , 2011, 2011 44th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).

[42]  edited by Jospeh Y-T. Leung,et al.  Handbook of scheduling , 2013 .

[43]  Naixue Xiong,et al.  A game-theoretic method of fair resource allocation for cloud computing services , 2010, The Journal of Supercomputing.

[44]  Athanasios V. Vasilakos,et al.  Security in cloud computing: Opportunities and challenges , 2015, Inf. Sci..