Brokering in interconnected cloud computing environments: A survey

Abstract Cloud computing provides computing platforms and facilitates to optimize utilization of infrastructure resources, reduces deployment time and increases flexibility. The popularity of cloud computing led to development of interconnected cloud computing environments (ICCE) such as hybrid cloud, inter-cloud, multi-cloud, and federated cloud, enabling the possibilities to share resources among individual clouds. However, individual proprietary technologies and access interfaces employed by cloud service providers made it difficult to share resources. Interoperability and portability are two of the major challenges to be addressed to ensure seamless access and sharing of resources and services. Many cloud service providers have similar service offerings but different access patterns. It is difficult and time consuming for a cloud user to select an appropriate cloud service as per the application’s requirement. Cloud user has to gather information from various cloud service providers and analyze them. Cloud broker has been proposed to address the challenge of cloud users to get best out of cloud provider. Cloud broker is an entity which works as an independent third party between cloud users and cloud providers. Cloud broker negotiates with several cloud providers as per user’s requirements and tries to select the best services. Cloud broker coordinates the sharing of resources and provides interoperability and portability with other cloud providers. In this paper, a comprehensive survey of cloud brokering in interconnected cloud computing environments has been provided. The need and importance of cloud broker has been discussed. The existing architectures and frameworks of Cloud Brokering are reviewed. A comprehensive literature survey of various Cloud Brokering techniques is presented. A taxonomy of Cloud Brokering techniques has been presented and analyzed on the basis of their strengths and weaknesses/limitations. The taxonomy includes pricing, multi-criteria, quality of services, optimization and trust techniques. The techniques are analyzed on various performance metrics. Research challenges and open problems are identified from reviewed techniques. A model for cloud broker is proposed to address identified challenges. We hope that our work will enable researchers to launch and dive deep into Cloud Brokering challenges in interconnected cloud computing environments.

[1]  Xiaodong Liu,et al.  A Classification and Comparison Framework for Cloud Service Brokerage Architectures , 2018, IEEE Transactions on Cloud Computing.

[2]  Rajkumar Buyya,et al.  Inter‐Cloud architectures and application brokering: taxonomy and survey , 2014, Softw. Pract. Exp..

[3]  Chao-Tung Yang,et al.  Auction-Based Resource Provisioning with SLA Consideration on Multi-cloud Systems , 2013, 2013 IEEE 37th Annual Computer Software and Applications Conference Workshops.

[4]  Rajkumar Buyya,et al.  Interconnected Cloud Computing Environments , 2014, ACM Comput. Surv..

[5]  Rajkumar Buyya,et al.  A Taxonomy of QoS Management and Service Selection Methodologies for Cloud Computing , 2011 .

[6]  Ling Tang,et al.  Double-Sided Bidding Mechanism for Resource Sharing in Mobile Cloud , 2017, IEEE Transactions on Vehicular Technology.

[7]  Péter Kacsuk,et al.  FCM: an Architecture for Integrating IaaS Cloud Systems , 2011, CLOUD 2011.

[8]  Misbah Liaqat,et al.  Federated cloud resource management: Review and discussion , 2017, J. Netw. Comput. Appl..

[9]  Rajkumar Buyya,et al.  CloudAnalyst: A CloudSim-Based Visual Modeller for Analysing Cloud Computing Environments and Applications , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[10]  Rajkumar Buyya,et al.  Author's Personal Copy Future Generation Computer Systems a Coordinator for Scaling Elastic Applications across Multiple Clouds , 2022 .

[11]  Rajkumar Buyya,et al.  Cluster Computing: High-Performance, High-Availability, and High-Throughput Processing on a Network of Computers , 2006, Handbook of Nature-Inspired and Innovative Computing.

[12]  Kannan Govindarajan,et al.  CLOUDRB: A framework for scheduling and managing High-Performance Computing (HPC) applications in science cloud , 2014, Future Gener. Comput. Syst..

[13]  Sherif Abdelwahed,et al.  Towards an autonomic performance management approach for a cloud broker environment using a decomposition-coordination based methodology , 2016, Future Gener. Comput. Syst..

[14]  Alex Delis,et al.  Live VM Migration Under Time-Constraints in Share-Nothing IaaS-Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[15]  M. Kunze,et al.  Cloud Federation , 2011 .

[16]  U. Rieder,et al.  Markov Decision Processes , 2010 .

[17]  Marin Litoiu,et al.  Introducing STRATOS: A Cloud Broker Service , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[18]  Guofeng Wang,et al.  A Cloud Access Security Broker based approach for encrypted data search and sharing , 2017, 2017 International Conference on Computing, Networking and Communications (ICNC).

[19]  Mohammad Fairus Khalid,et al.  A survey on SLA-based brokering for inter-cloud computing , 2015, 2015 Second International Conference on Computing Technology and Information Management (ICCTIM).

[20]  Cristian Mateos,et al.  A Three-level Scheduler to Execute Scientific Experiments on Federated Clouds , 2015, IEEE Latin America Transactions.

[21]  Salvatore Venticinque,et al.  Cloud Brokering as a Service , 2013, 2013 Eighth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[22]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[23]  Zièd Choukair,et al.  Trust Assurance in Cloud Services with the Cloud Broker Architecture for Dependability , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[24]  Olivier Togni,et al.  Broker and federation based Cloud networking architecture for IaaS and NaaS QoS guarantee , 2016, 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[25]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[26]  Haiying Shen,et al.  An Economical and SLO-Guaranteed Cloud Storage Service Across Multiple Cloud Service Providers , 2017, IEEE Trans. Parallel Distributed Syst..

[27]  David Bernstein,et al.  Containers and Cloud: From LXC to Docker to Kubernetes , 2014, IEEE Cloud Computing.

[28]  Kwang Mong Sim,et al.  Concurrent Negotiation and Coordination for Grid Resource Coallocation , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Kui Wu,et al.  Online Resource Scheduling Under Concave Pricing for Cloud Computing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[30]  Guofeng Wang,et al.  SafeBox: A scheme for searching and sharing encrypted data in cloud applications , 2017, 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[31]  Singiresu S. Rao.  Engineering Optimization : Theory and Practice , 2010 .

[32]  Tommaso Melodia,et al.  The Value of Cooperation: Minimizing User Costs in Multi-Broker Mobile Cloud Computing Networks , 2017, IEEE Transactions on Cloud Computing.

[33]  Marc St-Hilaire,et al.  Economic and Energy Considerations for Resource Augmentation in Mobile Cloud Computing , 2018, IEEE Transactions on Cloud Computing.

[34]  Pascal Bouvry,et al.  A new model for VMMP dealing with execution time uncertainty in a multi-clouds system , 2015, 2015 IEEE 4th International Conference on Cloud Networking (CloudNet).

[35]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[36]  Chris Rose,et al.  A Break in the Clouds: Towards a Cloud Definition , 2011 .

[37]  Iván Arce,et al.  Guest Editors' Introduction: In Cloud Computing We Trust - But Should We? , 2010, IEEE Secur. Priv..

[38]  Haiying Shen,et al.  An Economical and SLO-Guaranteed Cloud Storage Service Across Multiple Cloud Service Providers , 2016, IEEE Transactions on Parallel and Distributed Systems.

[39]  A. Atkinson.  The Economics of the Welfare State , 1996 .

[40]  Daniel A. Menascé,et al.  Virtualization: Concepts, Applications, and Performance Modeling , 2005, Int. CMG Conference.

[41]  Joni da Silva Fraga,et al.  Conceptual model of brokering and authentication in cloud federations , 2015, 2015 IEEE 4th International Conference on Cloud Networking (CloudNet).

[42]  Elarbi Badidi.  A context broker federation for QoC-driven selection of cloud-based context services , 2014, The 9th International Conference for Internet Technology and Secured Transactions (ICITST-2014).

[43]  Benjamín Barán,et al.  A Genetic Algorithm for Dynamic Cloud Application Brokerage , 2016, 2016 IEEE International Conference on Cloud Engineering (IC2E).

[44]  Kalyanmoy Deb,et al.  Multi-Objective Evolutionary Algorithms , 2015, Handbook of Computational Intelligence.

[45]  Shrisha Rao,et al.  A Mechanism Design Approach to Resource Procurement in Cloud Computing , 2014, IEEE Transactions on Computers.

[46]  Jingwei Li,et al.  MMB$^{cloud}$ -Tree: Authenticated Index for Verifiable Cloud Service Selection , 2017, IEEE Transactions on Dependable and Secure Computing.

[47]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[48]  Dana Petcu.  Portability and Interoperability between Clouds: Challenges and Case Study - (Invited Paper) , 2011, ServiceWave.

[49]  Maristela Holanda,et al.  BioNimbuZ: A federated cloud platform for bioinformatics applications , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[50]  Feng Zhou,et al.  Service Operator-Aware Trust Scheme for Resource Matchmaking across Multiple Clouds , 2015, IEEE Transactions on Parallel and Distributed Systems.

[51]  Warren P. Adams,et al.  A Reformulation-Linearization Technique for Solving Discrete and Continuous Nonconvex Problems , 1998 .

[52]  Philippe Thiran,et al.  Communication of Technical QoS among Cloud Brokers , 2014, 2014 IEEE International Conference on Cloud Engineering.

[53]  Andrea Clematis,et al.  Delivering cloud services with QoS requirements: Business opportunities, architectural solutions and energy-saving aspects , 2016, Future Gener. Comput. Syst..

[54]  Lakshmi Sobhana Kalli,et al.  Market-Oriented Cloud Computing : Vision , Hype , and Reality for Delivering IT Services as Computing , 2013 .

[55]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[56]  Christoph Meinel,et al.  Unified logging system for monitoring multiple cloud storage providers in cloud storage broker , 2018, 2018 International Conference on Information Networking (ICOIN).

[57]  Yuri Demchenko,et al.  Defining Intercloud Federation Framework for Multi-provider Cloud Services Integration , 2013, CLOUD 2013.

[58]  Daniele D'Agostino,et al.  MOEA-Based Brokering for Hybrid Clouds , 2017, 2017 International Conference on High Performance Computing & Simulation (HPCS).

[59]  Gregoris Mentzas,et al.  Preference-based cloud service recommendation as a brokerage service , 2014, CCB '14.

[60]  Muli Ben-Yehuda,et al.  The Reservoir model and architecture for open federated cloud computing , 2009, IBM J. Res. Dev..

[61]  Ravi S. Sandhu,et al.  Authorization Federation in IaaS Multi Cloud , 2015, SCC@ASIACCS.

[62]  Yedhu Sastri,et al.  Evaluation of Docker containers based on hardware utilization , 2015, 2015 International Conference on Control Communication & Computing India (ICCC).

[63]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[64]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[65]  Kwang Mong Sim,et al.  A Market–Driven Model for Designing Negotiation Agents , 2002, Comput. Intell..

[66]  Frédéric Desprez,et al.  Image Transfer and Storage Cost Aware Brokering Strategies for Multiple Clouds , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[67]  Albert Y. Zomaya,et al.  Privacy-Aware Scheduling SaaS in High Performance Computing Environments , 2017, IEEE Transactions on Parallel and Distributed Systems.

[68]  Alagan Anpalagan,et al.  Optimal Cloud Broker Method for Cloud Selection in Mobile Inter-cloud Computing , 2015, 2015 9th International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[69]  Patrizio Dazzi,et al.  QBROKAGE: A Genetic Approach for QoS Cloud Brokering , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[70]  Ioannis Lambadaris,et al.  Cloud Customer's Historical Record Based Resource Pricing , 2016, IEEE Transactions on Parallel and Distributed Systems.

[71]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[72]  Jarek Nabrzyski,et al.  Cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[73]  Baochun Li,et al.  Dynamic Cloud Instance Acquisition via IaaS Cloud Brokerage , 2015, IEEE Transactions on Parallel and Distributed Systems.

[74]  Salvatore Venticinque,et al.  Multiobjective Optimization for Brokering of Multicloud Service Composition , 2016, ACM Trans. Internet Techn..

[75]  Reza Baradaran Kazemzadeh,et al.  PROMETHEE: A comprehensive literature review on methodologies and applications , 2010, Eur. J. Oper. Res..

[76]  Andrea Clematis,et al.  A QoS-aware broker for hybrid clouds , 2012, Computing.

[77]  P. Santhi Thilagam,et al.  A broker based approach for cloud provider selection , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[78]  Michael D. Hogan,et al.  NIST Cloud Computing Standards Roadmap , 2013 .

[79]  Iyad Rahwan,et al.  Intelligent Agents for Automated One-to-Many E-Commerce Negotiation , 2002, ACSC.

[80]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[81]  David Brumley,et al.  Virtual Appliances for Deploying and Maintaining Software , 2003, LISA.

[82]  Eui-nam Huh,et al.  Advance resource reservation and QoS based refunding in cloud federation , 2014, 2014 IEEE Globecom Workshops (GC Wkshps).

[83]  Kwang Mong Sim,et al.  Complex and Concurrent Negotiations for Multiple Interrelated e-Markets , 2013 .

[84]  Eui-nam Huh,et al.  Broker as a Service (BaaS) Pricing and Resource Estimation Model , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[85]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[86]  Zahid Raza,et al.  Auction Based Resource Provisioning in Cloud Computing , 2018, SpringerBriefs in Computer Science.

[87]  Xiaohua Jia,et al.  Reservation schemes for IaaS cloud broker: a time‐multiplexing way for different rental time , 2017, Concurr. Comput. Pract. Exp..

[88]  Benjamín Barán,et al.  Auction-based resource provisioning in cloud computing. A taxonomy , 2015, 2015 Latin American Computing Conference (CLEI).

[89]  Vincenzo Suraci,et al.  A Resource Allocation Algorithm of Multi-cloud Resources Based on Markov Decision Process , 2013, 2013 IEEE 5th International Conference on Cloud Computing Technology and Science.

[90]  Patrizio Dazzi,et al.  Machine-Learning Based Approaches for Cloud Brokering , 2017 .

[91]  Mianxiong Dong,et al.  Multiobjective Optimization in Cloud Brokering Systems for Connected Internet of Things , 2017, IEEE Internet of Things Journal.

[92]  Jane Siegel,et al.  Cloud Services Measures for Global Use: The Service Measurement Index (SMI) , 2012, 2012 Annual SRII Global Conference.

[93]  Steven Diamond,et al.  Blueprint for the Intercloud - Protocols and Formats for Cloud Computing Interoperability , 2009, 2009 Fourth International Conference on Internet and Web Applications and Services.

[94]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[95]  Shahram Latifi,et al.  Minimizing energy consumption of smart grid data centers using cloud computing , 2017, 2017 IEEE 7th Annual Computing and Communication Workshop and Conference (CCWC).

[96]  Rajkumar Buyya,et al.  InterCloud: Utility-Oriented Federation of Cloud Computing Environments for Scaling of Application Services , 2010, ICA3PP.

[97]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[98]  Christophe Cérin,et al.  The Promethee Method for Cloud Brokering with Trust and Assurance Criteria , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium Workshop.

[99]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[100]  Nicola Sfondrini,et al.  SLM-as-a-Service - a conceptual framework , 2017, 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).

[101]  Yonggyu Lee,et al.  An Adaptive Workflow Scheduling Scheme Based on an Estimated Data Processing Rate for Next Generation Sequencing in Cloud Computing , 2012, J. Inf. Process. Syst..

[102]  Shyam S. Wagle.  Cloud Service Optimization Method for Multi-cloud Brokering , 2015, 2015 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM).

[103]  Rajkumar Buyya,et al.  Brokering Algorithms for Optimizing the Availability and Cost of Cloud Storage Services , 2013, 2013 IEEE 5th International Conference on Cloud Computing Technology and Science.

[104]  Abhishek Srivastava,et al.  Cloud Brokering Architecture for Dynamic Placement of Virtual Machines , 2015, 2015 IEEE 8th International Conference on Cloud Computing.