Self-management Challenges for Multi-cloud Architectures - (Invited Paper)

Addressing the management challenges for a multitude of distributed cloud architectures, we focus on the three complementary cloud management problems of predictive elasticity, admission control, and placement (or scheduling) of virtual machines. As these problems are intrinsically intertwined we also propose an approach to optimize the overall system behavior by policy-tuning for the tools handling each of them. Moreover, in order to facilitate the execution of some of the management decisions, we also propose new algorithms for live migration of virtual machines with very high workload and/or over low-bandwidth networks, using techniques such as caching, compression, and prioritization of memory pages.

[1]  Lui Sha,et al.  Adaptive Control of Multi-Tiered Web Applications Using Queueing Predictor , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[2]  Johan Tordsson,et al.  A standards-based Grid resource brokering service supporting advance reservations, coallocation, and cross-Grid interoperability , 2009 .

[3]  Jae-Dong Son.  Optimal admission and pricing control problem with deterministic service times and sideline profit , 2008, Queueing Syst. Theory Appl..

[4]  Petter Svärd,et al.  Evaluation of delta compression techniques for efficient live migration of large virtual machines , 2011, VEE '11.

[5]  Ness B. Shroff,et al.  Admission control for statistical QoS: theory and practice , 1999, IEEE Netw..

[6]  Adir Even,et al.  Making money with clouds: Revenue optimization through automated policy decisions , 2009 .

[7]  Johan Tordsson,et al.  Modeling for Dynamic Cloud Scheduling Via Migration of Virtual Machines , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[8]  Erik Elmroth,et al.  Design and evaluation of a decentralized system for grid-wide fairshare scheduling , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[9]  Erik Elmroth,et al.  Increasing Flexibility and Abstracting Complexity in Service-based Grid and Cloud Software , 2011, CLOSER.

[10]  Johan Tordsson,et al.  An adaptive hybrid elasticity controller for cloud infrastructures , 2012, 2012 IEEE Network Operations and Management Symposium.

[11]  Anja Feldmann,et al.  Live wide-area migration of virtual machines including local persistent state , 2007, VEE '07.

[12]  Erik Elmroth,et al.  Accounting and Billing for Federated Cloud Infrastructures , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[13]  Hamid Ahmadi,et al.  Equivalent Capacity and Its Application to Bandwidth Allocation in High-Speed Networks , 1991, IEEE J. Sel. Areas Commun..

[14]  Rajkumar Buyya,et al.  Adapting Market-Oriented Scheduling Policies for Cloud Computing , 2010, ICA3PP.

[15]  Benny Rochwerger,et al.  Reservoir - When One Cloud Is Not Enough , 2011, Computer.

[16]  Johan Tordsson,et al.  Grid resource brokering algorithms enabling advance reservations and resource selection based on performance predictions , 2008, Future Gener. Comput. Syst..

[17]  Waheed Iqbal,et al.  Adaptive resource provisioning for read intensive multi-tier applications in the cloud , 2011, Future Gener. Comput. Syst..

[18]  Timothy Roscoe,et al.  Resource overbooking and application profiling in shared hosting platforms , 2002, OSDI '02.

[19]  Cesare Pautasso,et al.  Engineering Autonomic Controllers for Virtualized Web Applications , 2010, ICWE.

[20]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[21]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[22]  Erik Elmroth,et al.  Distributed usage logging for federated Grids , 2010, Future Gener. Comput. Syst..

[23]  Prashant J. Shenoy,et al.  Agile dynamic provisioning of multi-tier Internet applications , 2008, TAAS.

[24]  Lee Rainie,et al.  The future of cloud computing , 2010 .

[25]  Erik Elmroth,et al.  Scheduling and monitoring of internally structured services in Cloud federations , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).

[26]  Nicolas Marchand,et al.  Experience with CONSER: A System for Server Control through Fluid Modeling , 2011, IEEE Transactions on Computers.

[27]  Leon Gommans,et al.  Seamless live migration of virtual machines over the MAN/WAN , 2006, Future Gener. Comput. Syst..

[28]  Muli Ben-Yehuda,et al.  The Reservoir model and architecture for open federated cloud computing , 2009, IBM J. Res. Dev..

[29]  Erik Elmroth,et al.  Interfaces for Placement, Migration, and Monitoring of Virtual Machines in Federated Clouds , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[30]  Prashant J. Shenoy,et al.  Autonomic mix-aware provisioning for non-stationary data center workloads , 2010, ICAC '10.

[31]  Erik Elmroth,et al.  Unifying Cloud Management: Towards Overall Governance of Business Level Objectives , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[32]  Benoit Hudzia,et al.  Future Generation Computer Systems Optimis: a Holistic Approach to Cloud Service Provisioning , 2022 .

[33]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[34]  San Murugesan.  Web engineering , 1999, LINK.

[35]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[36]  Barbara Horner-Miller,et al.  Proceedings of the 2006 ACM/IEEE conference on Supercomputing , 2006 .

[37]  Laurent Massoulié,et al.  Bandwidth sharing and admission control for elastic traffic , 2000, Telecommun. Syst..

[38]  Balázs Kégl,et al.  Utility-Based Reinforcement Learning for Reactive Grids , 2008, 2008 International Conference on Autonomic Computing.

[39]  Debasis Mitra,et al.  Effective bandwidth of general Markovian traffic sources and admission control of high speed networks , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[40]  Johan Tordsson,et al.  Cloud brokering mechanisms for optimized placement of virtual machines across multiple providers , 2012, Future Gener. Comput. Syst..

[41]  Petter Svärd,et al.  High Performance Live Migration through Dynamic Page Transfer Reordering and Compression , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[42]  Steve R. White,et al.  Unity: experiences with a prototype autonomic computing system , 2004 .

[43]  Andrzej Kochut,et al.  Dynamic Placement of Virtual Machines for Managing SLA Violations , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.