A Taxonomy and Survey of Cloud Resource Orchestration Techniques

Cloud services and applications prove indispensable amid today’s modern utility-based computing. The cloud has displayed a disruptive and growing impact on everyday computing tasks. However, facilitating the orchestration of cloud resources to build such cloud services and applications is yet to unleash its entire magnitude of power. Accordingly, it is paramount to devise a unified and comprehensive analysis framework to accelerate fundamental understanding of cloud resource orchestration in terms of concepts, paradigms, languages, models, and tools. This framework is essential to empower effective research, comprehension, comparison, and selection of cloud resource orchestration models, languages, platforms, and tools. This article provides such a comprehensive framework while analyzing the relevant state of the art in cloud resource orchestration from a novel and holistic viewpoint.

[1]  Zoltán Ádám Mann,et al.  Allocation of Virtual Machines in Cloud Data Centers—A Survey of Problem Models and Optimization Algorithms , 2015, ACM Comput. Surv..

[2]  Jian Cao,et al.  CloudMap: A Visual Notation for Representing and Managing Cloud Resources , 2016, CAiSE.

[3]  Tao Li,et al.  ASAP: A Self-Adaptive Prediction System for Instant Cloud Resource Demand Provisioning , 2011, 2011 IEEE 11th International Conference on Data Mining.

[4]  Jacobus E. van der Merwe,et al.  Cloud Resource Orchestration: A Data-Centric Approach , 2011, CIDR.

[5]  Liana L. Fong,et al.  Cloud federation in a layered service model , 2012, J. Comput. Syst. Sci..

[6]  Schahram Dustdar,et al.  SPEEDL - A Declarative Event-Based Language to Define the Scaling Behavior of Cloud Applications , 2015, 2015 IEEE World Congress on Services.

[7]  Dejan S. Milojicic,et al.  Guest Editors' Introduction: Special Issue on Cloud Computing , 2013, IEEE Trans. Parallel Distributed Syst..

[8]  Boualem Benatallah,et al.  ProcessBase: A Hybrid Process Management Platform , 2014, ICSOC.

[9]  Ernesto Damiani,et al.  From Security to Assurance in the Cloud , 2015, ACM Comput. Surv..

[10]  Rajiv Ranjan,et al.  Survey of Techniques and Architectures for Designing Energy-Efficient Data Centers , 2016, IEEE Systems Journal.

[11]  Wolfgang Barth,et al.  Nagios: System and Network Monitoring , 2006 .

[12]  Albert Y. Zomaya,et al.  A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems , 2010, Adv. Comput..

[13]  Rajkumar Buyya,et al.  Interconnected Cloud Computing Environments , 2014, ACM Comput. Surv..

[14]  Arshdeep Bahga,et al.  Rapid Prototyping of Multitier Cloud-Based Services and Systems , 2013, Computer.

[15]  Boualem Benatallah,et al.  ServiceBase: A Programming Knowledge-Base for Service Oriented Development , 2013, DASFAA.

[16]  Michael H. Kalantar,et al.  An architecture for virtual solution composition and deployment in infrastructure clouds , 2009, VTDC '09.

[17]  Mohd Fadzil Hassan,et al.  Renegotiation in Service Level Agreement Management for a Cloud-Based System , 2015, ACM Comput. Surv..

[18]  Srikumar Venugopal,et al.  Elastic Business Process Management: State of the art and open challenges for BPM in the cloud , 2014, Future Gener. Comput. Syst..

[19]  Rolf Stadler,et al.  Resource Management in Clouds: Survey and Research Challenges , 2015, Journal of Network and Systems Management.

[20]  Jose M. Alcaraz Calero,et al.  Towards an architecture for deploying elastic services in the cloud , 2012, Softw. Pract. Exp..

[21]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[22]  Amin Vahdat,et al.  Remote Control: Distributed Application Configuration, Management, and Visualization with Plush , 2007, LISA.

[23]  Matjaz B. Juric,et al.  WS-BPEL 2.0 Beginner's Guide , 2014 .

[24]  Armin Haller,et al.  Investigating decision support techniques for automating Cloud service selection , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[25]  Manuel Wimmer,et al.  The Evolution of CloudML and its Applications , 2015, CloudMDE@MoDELS.

[26]  Rajkumar Buyya,et al.  Model-driven provisioning of application services in hybrid computing environments , 2013, Future Gener. Comput. Syst..

[27]  Rajiv Ranjan,et al.  Dimensions for Evaluating Cloud Resource Orchestration Frameworks , 2016, Computer.

[28]  Boualem Benatallah,et al.  Unified Representation and Reuse of Federated Cloud Resources Configuration Knowledge , 2015, 2015 IEEE 19th International Enterprise Distributed Object Computing Conference.

[29]  Philip Robinson,et al.  SLA-driven predictive orchestration for distributed cloud-based mobile services , 2013, 2013 IEEE International Conference on Communications Workshops (ICC).

[30]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[31]  Armin Haller,et al.  A Declarative Recommender System for Cloud Infrastructure Services Selection , 2012, GECON.

[32]  Oliver Kopp,et al.  BPMN4TOSCA: A Domain-Specific Language to Model Management Plans for Composite Applications , 2012, BPMN.

[33]  Grace A. Lewis,et al.  Role of Standards in Cloud-Computing Interoperability , 2013, 2013 46th Hawaii International Conference on System Sciences.

[34]  Peter Zadrozny,et al.  Big Data Analytics Using Splunk: Deriving Operational Intelligence from Social Media, Machine Data, Existing Data Warehouses, and Other Real-Time Streaming Sources , 2013 .

[35]  Alva L. Couch,et al.  Seeking Closure in an Open World: A Behavioral Agent Approach to Configuration Management , 2003, LISA.

[36]  Athanasios V. Vasilakos,et al.  Cloud Computing , 2014, ACM Comput. Surv..

[37]  Waheed Iqbal,et al.  Adaptive resource provisioning for read intensive multi-tier applications in the cloud , 2011, Future Gener. Comput. Syst..

[38]  Frank Leymann,et al.  Cloud Computing Patterns , 2014, Springer Vienna.

[39]  Muhammad Ali Babar,et al.  Architecting cloud‐enabled systems: a systematic survey of challenges and solutions , 2017, Softw. Pract. Exp..

[40]  Mark Chignell,et al.  The Smart Internet - Current Research and Future Applications , 2010, The Smart Internet.

[41]  Mark von Rosing,et al.  Business Process Model and Notation - BPMN , 2015, The Complete Business Process Handbook, Vol. I.

[42]  George Lawton.  LAMP lights enterprise development efforts , 2005, Computer.

[43]  Manish Parashar,et al.  CometCloud: An Autonomic Cloud Engine , 2011, CloudCom 2011.

[44]  Victor R. Basili,et al.  Iterative and incremental developments. a brief history , 2003, Computer.

[45]  Michael A. Cusumano,et al.  Cloud computing and SaaS as new computing platforms , 2010, CACM.

[46]  Hai Dong,et al.  Long-Term QoS-Aware Cloud Service Composition Using Multivariate Time Series Analysis , 2016, IEEE Transactions on Services Computing.

[47]  Mark Silberstein,et al.  One Interface to Rule them All: A Hardware/Software Co-Design for Disaggregated Computing , 2019 .

[48]  Wolfgang Emmerich,et al.  Service-Level Agreements for Electronic Services , 2010, IEEE Transactions on Software Engineering.

[49]  Mark Burgess.  Testable system administration , 2011, CACM.

[50]  Amin Vahdat,et al.  Enforcing Performance Isolation Across Virtual Machines in Xen , 2006, Middleware.

[51]  Sherali Zeadally,et al.  A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems , 2016, Computing.

[52]  Jan A. Bergstra,et al.  A static theory of promises , 2008, ArXiv.

[53]  Madhurranjan Mohaan,et al.  Learning Ansible , 2014 .

[54]  Farookh Khadeer Hussain,et al.  An online fuzzy Decision Support System for Resource Management in cloud environments , 2013, 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS).

[55]  Rajkumar Buyya,et al.  Inter‐Cloud architectures and application brokering: taxonomy and survey , 2014, Softw. Pract. Exp..

[56]  Salim Hariri,et al.  Autonomic Computing: An Overview , 2004, UPP.

[57]  Josh Atwell,et al.  Mastering VMware vSphere 6 , 2015 .

[58]  Sam Malek,et al.  A Systematic Survey of Self-Protecting Software Systems , 2014, ACM Trans. Auton. Adapt. Syst..

[59]  Laurian M. Chirica,et al.  The entity-relationship model: toward a unified view of data , 1975, SIGF.

[60]  Ajay Mohindra,et al.  Solution-based deployment of complex application services on a Cloud , 2010, Proceedings of 2010 IEEE International Conference on Service Operations and Logistics, and Informatics.

[61]  Wei Huang,et al.  The State of Public Infrastructure-as-a-Service Cloud Security , 2015, ACM Comput. Surv..

[62]  Schahram Dustdar,et al.  Profiling-Based Task Scheduling for Factory-Worker Applications in Infrastructure-as-a-Service Clouds , 2014, 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications.

[63]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[64]  Wouter Joosen,et al.  A Survey of System Configuration Tools , 2010, LISA.

[65]  David Garlan,et al.  Stitch: A language for architecture-based self-adaptation , 2012, J. Syst. Softw..

[66]  Uta Dresdner,et al.  Cloud Computing Methodology Systems And Applications , 2016 .

[67]  Navin Sabharwal,et al.  Automation through Chef Opscode: A Hands-on Approach to Chef , 2014 .

[68]  Erik Elmroth,et al.  Interfaces for Placement, Migration, and Monitoring of Virtual Machines in Federated Clouds , 2009, 2009 Eighth International Conference on Grid and Cooperative Computing.

[69]  Alexander Lenk,et al.  Feature-Based Configuration of Vendor-Independent Deployments on IaaS , 2014, 2014 IEEE 18th International Enterprise Distributed Object Computing Conference.

[70]  Daniel Diaz,et al.  Using Constraint Programming to Manage Configurations in Self-Adaptive Systems , 2012, Computer.

[71]  M. Brian Blake,et al.  Adaptive Service Workflow Configuration and Agent-Based Virtual Resource Management in the Cloud* , 2013, 2013 IEEE International Conference on Cloud Engineering (IC2E).

[72]  Rajiv Ranjan,et al.  Cloud Resource Orchestration Programming: Overview, Issues, and Directions , 2015, IEEE Internet Computing.

[73]  Dana Petcu,et al.  MODAClouds: A model-driven approach for the design and execution of applications on multiple Clouds , 2012, 2012 4th International Workshop on Modeling in Software Engineering (MISE).

[74]  Matjaz B. Juric,et al.  Towards a unified taxonomy and architecture of cloud frameworks , 2013, Future Gener. Comput. Syst..

[75]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[76]  Boualem Benatallah,et al.  Web Service Composition , 2015 .

[77]  ZhiHui Lv,et al.  RPPS: A Novel Resource Prediction and Provisioning Scheme in Cloud Data Center , 2012, 2012 IEEE Ninth International Conference on Services Computing.

[78]  Asit Dan,et al.  A Service Level Agreement Language for Dynamic Electronic Services , 2003, Electron. Commer. Res..

[79]  David A. Maltz,et al.  Cloudward bound: planning for beneficial migration of enterprise applications to the cloud , 2010, SIGCOMM '10.

[80]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[81]  Schahram Dustdar,et al.  Winds of Change: From Vendor Lock-In to the Meta Cloud , 2013, IEEE Internet Computing.

[82]  Navin Sabharwal,et al.  Automation through Chef Opscode , 2014, Apress.

[83]  Boon Thau Loo,et al.  Declarative automated cloud resource orchestration , 2011, SoCC.

[84]  Boualem Benatallah,et al.  A Toolkit for Simplified Web-Services Programming , 2013, WISE.

[85]  Julien Subercaze,et al.  Context Awareness as a Service for Cloud Resource Optimization , 2015, IEEE Internet Computing.

[86]  Oliver Kopp,et al.  Unified Invocation of Scripts and Services for Provisioning, Deployment, and Management of Cloud Applications Based on TOSCA , 2014, CLOSER.

[87]  Frank Leymann,et al.  Standards-Based DevOps Automation and Integration Using TOSCA , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[88]  Marin Litoiu,et al.  Pattern-Based Deployment Service for Next Generation Clouds , 2013, 2013 IEEE Ninth World Congress on Services.

[89]  Rajiv Ranjan,et al.  An overview of the commercial cloud monitoring tools: research dimensions, design issues, and state-of-the-art , 2013, Computing.

[90]  Jun Zhang,et al.  Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches , 2015, ACM Comput. Surv..

[91]  Alexander Papaspyrou,et al.  Open cloud computing interface : core , 2011 .

[92]  Armin Haller,et al.  An ontology-based system for Cloud infrastructure services' discovery , 2012, 8th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom).

[93]  Xiaodong Liu,et al.  An approach to unified cloud service access, manipulation and dynamic orchestration via semantic cloud service operation specification framework , 2015, Journal of Cloud Computing.

[94]  MengChu Zhou,et al.  Modeling Self-Adaptive Software Systems With Learning Petri Nets , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[95]  Peter Van Roy,et al.  Programming paradigms for dummies: what every programmer should know , 2009 .

[96]  Matthew S. Wilson.  Constructing and Managing Appliances for Cloud Deployments from Repositories of Reusable Components , 2009, HotCloud.

[97]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[98]  Xinwen Zhang,et al.  Towards an Elastic Application Model for Augmenting the Computing Capabilities of Mobile Devices with Cloud Computing , 2011, Mob. Networks Appl..

[99]  Theo Lynn,et al.  A survey of Cloud monitoring tools: Taxonomy, capabilities and objectives , 2014, J. Parallel Distributed Comput..

[100]  Fermín Galán Márquez,et al.  Software architecture definition for on-demand cloud provisioning , 2010, HPDC '10.

[101]  Oliver Kopp,et al.  OpenTOSCA - A Runtime for TOSCA-Based Cloud Applications , 2013, ICSOC.

[102]  Clemens Danninger.  Using Constraint Solvers to Find Valid Software Configurations , 2015 .

[103]  Alistair N. Coles,et al.  The SmartFrog configuration management framework , 2009, OPSR.

[104]  Dana Petcu.  Consuming Resources and Services from Multiple Clouds , 2013, Journal of Grid Computing.

[105]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[106]  Inderveer Chana,et al.  QoS-Aware Autonomic Resource Management in Cloud Computing , 2015, ACM Comput. Surv..

[107]  Gbadebo Ayoade,et al.  A Survey on Hypervisor-Based Monitoring , 2015, ACM Comput. Surv..

[108]  Jan A. Bergstra,et al.  Promises, Impositions, and other Directionals , 2014, ArXiv.

[109]  Arpan Roy,et al.  Secure the Cloud , 2015, ACM Comput. Surv..

[110]  Nikos Loutas,et al.  Cloud4SOA: A Semantic-Interoperability PaaS Solution for Multi-cloud Platform Management and Portability , 2013, ESOCC.

[111]  Mark Burgess,et al.  Modeling Next Generation Configuration Management Tools , 2006, LISA.

[112]  Ben Hosmer.  Getting started with salt stack--the other configuration management system built with python , 2012 .

[113]  Peter Zadrozny,et al.  Big Data Analytics Using Splunk , 2013, Apress.

[114]  Rocco Aversa,et al.  Proceedings of the Federated Conference on Computer Science and Information Systems pp. 973–980 ISBN 978-83-60810-22-4 An Analysis of mOSAIC ontology for Cloud Resources annotation , 2022 .

[115]  Luke Kanies.  Puppet: Next-Generation Configuration Management , 2006, login Usenix Mag..

[116]  Marin Litoiu,et al.  Supporting application development with structured queries in the cloud , 2013, 2013 35th International Conference on Software Engineering (ICSE).

[117]  Mark Burgess.  Knowledge Management and Promises , 2009, AIMS.

[118]  Boualem Benatallah,et al.  Process-driven Configuration of Federated Cloud Resources , 2015, DASFAA.

[119]  Jinjun Chen,et al.  CloudGenius: A Hybrid Decision Support Method for Automating the Migration of Web Application Clusters to Public Clouds , 2015, IEEE Transactions on Computers.

[120]  Fang Liu,et al.  NIST Cloud Computing Reference Architecture , 2011, 2011 IEEE World Congress on Services.

[121]  G. Karagiannis,et al.  Taxonomy of cloud computing services , 2010, 2010 IEEE Globecom Workshops.

[122]  Hiroyuki Sato,et al.  A Cloud Trust Model in a Security Aware Cloud , 2010, 2010 10th IEEE/IPSJ International Symposium on Applications and the Internet.

[123]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.

[124]  Andreas Wilke,et al.  Skyport - Container-Based Execution Environment Management for Multi-cloud Scientific Workflows , 2014, 2014 5th International Workshop on Data-Intensive Computing in the Clouds.

[125]  Cheng-Zhong Xu,et al.  URL: A unified reinforcement learning approach for autonomic cloud management , 2012, J. Parallel Distributed Comput..