Review on cloud service evaluation and selection methods

To evaluate and select a Public Cloud Service (PCS) based on Cloud Service Requesters (CSRs) needs and demands a complex software engineering process. Selecting the wrong PCS may turn out to be costly and adversely affect business processes. To address these issues, many Cloud Evaluation and Selection Methods (CESMs) have been proposed by different researchers. Nevertheless, a number of CESMs' studies which have addressed the issue of evaluation and selection of the PCS based on the Quality of Service (QoS) have led to a different conclusion. This paper reviews the current limitations; namely, the strengths and weaknesses of CESMs for the PCS as well as the benefits they bring. The result has shown that current studies of CESMs are limited to certain types of quantifiable criteria, such as cost and performance. Non-quantifiable QoS criteria namely, trust, needs further attention. In addition, it has been identified that the majority of CESMs were not specifically designed for any CS layer; hence, it did not assist the CSP to evaluate their PCS with respect to other providers.

[1]  Maya Daneva,et al.  Cloud computing security requirements: A systematic review , 2012, 2012 Sixth International Conference on Research Challenges in Information Science (RCIS).

[2]  M. H. Supriya,et al.  Estimating Trust Value for Cloud Service Providers using Fuzzy Logic , 2012 .

[3]  Andrew P. Martin,et al.  Trust in the Cloud , 2011, Inf. Secur. Tech. Rep..

[4]  Elizabeth Chang,et al.  TRUST-EVALUATION METRIC FOR CLOUD APPLICATIONS , 2011 .

[5]  P. Bedi,et al.  Trustworthy Service Provider Selection in Cloud Computing Environment , 2012, 2012 International Conference on Communication Systems and Network Technologies.

[6]  YoungJae Song,et al.  Relative Weight Decision of Qualiy Attributes in Cloud Computing Service Using ANP , 2012 .

[7]  Soo Dong Kim,et al.  A Reusability Evaluation Suite for Cloud Services , 2011, 2011 IEEE 8th International Conference on e-Business Engineering.

[8]  Eui-nam Huh,et al.  Efficient service recommendation system for cloud computing market , 2009, ICIS.

[9]  K. K. F. Yuen,et al.  Software-as-a-Service evaluation in cloud paradigm: Primitive cognitive network process approach , 2012, 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2012).

[10]  Xiaoying Bai,et al.  Evaluating services on the cloud using ontology QoS model , 2011, Proceedings of 2011 IEEE 6th International Symposium on Service Oriented System (SOSE).

[11]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[12]  Xuyun Zhang,et al.  Preference-Aware QoS Evaluation for Cloud Web Service Composition Based on Artificial Neural Networks , 2010, WISM.

[13]  Lloyd G. Williams,et al.  Technology Selection: An Educational Approach , 1987, IEEE Transactions on Software Engineering.

[14]  Jörn Kuhlenkamp,et al.  Cloud Service Selection Based on Variability Modeling , 2012, ICSOC.

[15]  Wenying Zeng,et al.  Cloud service and service selection algorithm research , 2009, GEC '09.

[16]  Chen Yiming,et al.  SaaS Vendor Selection Basing on Analytic Hierarchy Process , 2011, 2011 Fourth International Joint Conference on Computational Sciences and Optimization.

[17]  Ahmad Kamil Mahmood,et al.  Trust -Based Service Selection in Public Cloud Computing Using Fuzzy Modified VIKOR Method , 2013 .

[18]  Santanu Das,et al.  An approach to identify the optimal cloud in cloud federation , 2012, CloudCom 2012.

[19]  Prasad Saripalli,et al.  MADMAC: Multiple Attribute Decision Methodology for Adoption of Clouds , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[20]  Gwo-Hshiung Tzeng,et al.  Improving cloud computing service in fuzzy environment — Combining fuzzy DANP and fuzzy VIKOR with a new hybrid FMCDM model , 2012, 2012 International conference on Fuzzy Theory and Its Applications (iFUZZY2012).

[21]  Rajkumar Buyya,et al.  A framework for ranking of cloud computing services , 2013, Future Gener. Comput. Syst..

[22]  Gwo-Hshiung Tzeng,et al.  Evaluating Cloud Computing Based Telecommunications Service Quality Enhancement by Using a New Hybrid MCDM Model , 2012 .

[23]  Farookh Khadeer Hussain,et al.  Towards Multi-criteria Cloud Service Selection , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[24]  Chinyao Low,et al.  Criteria for the Evaluation of a Cloud-Based Hospital Information System Outsourcing Provider , 2012, Journal of Medical Systems.

[25]  Shangguang Wang,et al.  Towards an accurate evaluation of quality of cloud service in service-oriented cloud computing , 2014, J. Intell. Manuf..

[26]  G. Nie,et al.  Evaluation Index System of Cloud Service and the Purchase Decision- Making Process Based on AHP , 2011 .

[27]  Mingchu Li,et al.  Flexible service selection with user-specific QoS support in service-oriented architecture , 2012, J. Netw. Comput. Appl..

[28]  Xiaowei Yang,et al.  CloudCmp: comparing public cloud providers , 2010, IMC '10.

[29]  Omkhar Arasaratnam,et al.  Introduction to Cloud Computing , 2011 .

[30]  Osman Ghazali,et al.  Trust Management in Cloud Computing: A Critical Review , 2012, ArXiv.

[31]  Rajkumar Buyya,et al.  QoS-aware Deployment of Network of Virtual Appliances Across Multiple Clouds , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[32]  Hwa-Young Jeong,et al.  The QoS-based MCDM system for SaaS ERP applications with Social Network , 2012, The Journal of Supercomputing.

[33]  Carlos Costa,et al.  Cloud services evaluation framework , 2012, OSDOC '12.

[34]  Rajiv Ranjan,et al.  CloudGenius: decision support for web server cloud migration , 2012, WWW.

[35]  Hoi Chan,et al.  Ranking and mapping of applications to cloud computing services by SVD , 2010, 2010 IEEE/IFIP Network Operations and Management Symposium Workshops.

[36]  Chen-Fang Tsai,et al.  Service Selection Based on Fuzzy TOPSIS Method , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[37]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[38]  Shawish Ahmed,et al.  Integrated QoS Utility-Based Model for Cloud Computing Service Provider Selection , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops.

[39]  Tim Kraska,et al.  An evaluation of alternative architectures for transaction processing in the cloud , 2010, SIGMOD Conference.

[40]  G. Karagiannis,et al.  Cloud computing services: taxonomy and comparison , 2011, Journal of Internet Services and Applications.