Towards an Efficient Federated Cloud Service Selection to Support Workflow Big Data Requirements

A R T I C L E I N F O A B S T R A C T Article history: Received: 14 August, 2018 Accepted: 27 September, 2018 Online: 08 October, 2018 Cloud Computing is considered nowadays an attractive solution to serve the Big Data storage, processing, and analytics needs. Given the high complexity of Big Data workflows and their contingent requirements, a single cloud provider might not be able alone to satisfy these needs. A multitude of cloud providers that offer myriad of cloud services and resources can be selected. However, such selection is not straightforward since it has to deal with the scaling of Big Data requirements, and the dynamic cloud resources fluctuation. This work proposes a novel cloud service selection approach which evaluates Big Data requirements, matches them in real time to most suitable cloud services, after which suggests the best matching services satisfying various Big Data processing requests. Our proposed selection scheme is performed throughout three phases: 1) capture Big Data workflow requirements using a Big Data task profile and map these to a set of QoS attributes, and prioritize cloud service providers (CSPs) that best fulfil these requirements, 2) rely on the pool of selected providers by phase 1 to then choose the suitable cloud services from a single provider to satisfy the Big Data task requirements, and 3) implement multiple providers selection to better satisfy requirements of Big Data workflow composed of multiples tasks. To cope with the multi-criteria selection problem, we extended the Analytic Hierarchy Process (AHP) to better provide more accurate rankings. We develop a set of experimental scenarios to evaluate our 3-phase selection schemes while verifying key properties such as scalability and selection accuracy. We also compared our selection approach to well-known selection schemes in the literature. The obtained results demonstrate that our approach perform very well compared to the other approaches and efficiently select the most suitable cloud services that guarantee Big Data tasks and workflow QoS requirements.

[1]  Elarbi Badidi,et al.  A Cloud Service Broker for SLA-based SaaS provisioning , 2013, International Conference on Information Society (i-Society 2013).

[2]  R. Venkata Rao,et al.  Improved Multiple Attribute Decision Making Methods , 2013 .

[3]  Jemal H. Abawajy,et al.  Determining Service Trustworthiness in Intercloud Computing Environments , 2009, 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks.

[4]  Anne H. H. Ngu,et al.  Enabling Personalized Composition and Adaptive Provisioning of Web Services , 2004, CAiSE.

[5]  Rajkumar Buyya,et al.  Interconnected Cloud Computing Environments , 2014, ACM Comput. Surv..

[6]  Assessment of cloud service provider quality metrics , 2017, 2017 International Conference on Information and Telecommunication Technologies and Radio Electronics (UkrMiCo).

[7]  Armin Haller,et al.  A Declarative Recommender System for Cloud Infrastructure Services Selection , 2012, GECON.

[8]  Jinmee Kim,et al.  Cloud service broker portal: Main entry point for multi-cloud service providers and consumers , 2014, 16th International Conference on Advanced Communication Technology.

[9]  R. Venkata Rao,et al.  Decision Making in Manufacturing Environment Using Graph Theory and Fuzzy Multiple Attribute Decision Making Methods , 2013 .

[10]  Ahmad Kamil Mahmood,et al.  Trust -Based Service Selection in Public Cloud Computing Using Fuzzy Modified VIKOR Method , 2013 .

[11]  Kanagasabai Rajaraman,et al.  OWL-S Based Semantic Cloud Service Broker , 2012, 2012 IEEE 19th International Conference on Web Services.

[12]  Valentin Cristea,et al.  The Art of Scheduling for Big Data Science , 2015, Big Data - Algorithms, Analytics, and Applications.

[13]  Nor Badrul Anuar,et al.  Cloud Service Selection Using Multicriteria Decision Analysis , 2014, TheScientificWorldJournal.

[14]  Marty Humphrey,et al.  An automated approach to cloud storage service selection , 2011, ScienceCloud '11.

[15]  S. Khaddaj,et al.  Cloud Computing: Service Provisioning and User Requirements , 2012, 2012 11th International Symposium on Distributed Computing and Applications to Business, Engineering & Science.

[16]  Rajkumar Buyya,et al.  A framework for ranking of cloud computing services , 2013, Future Gener. Comput. Syst..

[17]  David Bernstein,et al.  Intercloud Security Considerations , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[18]  Hai Jin,et al.  QoS-Driven Service Selection for Multi-tenant SaaS , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[19]  Qiang He,et al.  QoS-Aware Service Recommendation for Multi-tenant SaaS on the Cloud , 2015, 2015 IEEE International Conference on Services Computing.

[20]  Pascal Bouvry,et al.  Cloud service providers ranking based on service delivery and consumer experience , 2015, 2015 IEEE 4th International Conference on Cloud Networking (CloudNet).

[21]  Mohamed Adel Serhani,et al.  A Model for Multi-levels SLA Monitoring in Federated Cloud Environment , 2013, 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 2013 IEEE 10th International Conference on Autonomic and Trusted Computing.

[22]  Mohd Fadzil Hassan,et al.  Renegotiation in Service Level Agreement Management for a Cloud-Based System , 2015, ACM Comput. Surv..

[23]  Cheng-Yuan Lin,et al.  A Multi-objective Evolutionary Approach for Cloud Service Provider Selection Problems with Dynamic Demands , 2014, EvoApplications.

[24]  Anne H. H. Ngu,et al.  QoS-aware middleware for Web services composition , 2004, IEEE Transactions on Software Engineering.

[25]  Anne H. H. Ngu,et al.  Declarative composition and peer-to-peer provisioning of dynamic Web services , 2002, Proceedings 18th International Conference on Data Engineering.

[26]  O AkinwunmiA.,et al.  A Trustworhty Model for Reliable Cloud Service Discovery , 2014 .

[27]  Frank Teuteberg,et al.  Decision-making in cloud computing environments: A cost and risk based approach , 2011, Information Systems Frontiers.

[28]  Steven Klutho,et al.  Mathematical Decision Making An Overview of the Analytic Hierarchy Process , 2013 .

[29]  Elizabeth Chang,et al.  TRUST-EVALUATION METRIC FOR CLOUD APPLICATIONS , 2011 .

[30]  Boris Motik,et al.  OWL 2: The next step for OWL , 2008, J. Web Semant..

[31]  Claus Pahl,et al.  Autonomic resource provisioning for cloud-based software , 2014, SEAMS 2014.

[32]  Rajiv Ranjan,et al.  A Cloud Infrastructure Service Recommendation System for Optimizing Real-time QoS Provisioning Constraints , 2015, ArXiv.

[33]  Shangguang Wang,et al.  Towards an accurate evaluation of quality of cloud service in service-oriented cloud computing , 2014, J. Intell. Manuf..

[34]  Cosimo Anglano,et al.  FC2Q: exploiting fuzzy control in server consolidation for cloud applications with SLA constraints , 2015, Concurr. Comput. Pract. Exp..