Cloud service evaluation method-based Multi-Criteria Decision-Making: A systematic literature review

[1]  Russell L. Ackoff,et al.  An Approximate Measure of Value , 1954, Oper. Res..

[2]  Ralph L. Keeney,et al.  Utility Independence and Preferences for Multiattributed Consequences , 1971, Oper. Res..

[3]  L. J. Savage,et al.  The Foundations of Statistics , 1955 .

[4]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[5]  T. L. Saaty.  A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[6]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[7]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[8]  Benjamin F. Hobbs,et al.  What Can We Learn from Experiments in Multiobjective Decision Analysis? , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  V. Belton.  A comparison of the analytic hierarchy process and a simple multi-attribute value function , 1986 .

[10]  Peter Nijkamp,et al.  Multicriteria evaluation in physical planning , 1990 .

[11]  M. Scriven.  Evaluation thesaurus, 4th ed. , 1991 .

[12]  Tom Carney.  Fourth Generation Evaluation , 1991 .

[13]  Miroslaw J. Skibniewski,et al.  Evaluation of Advanced Construction Technology with AHP Method , 1992 .

[14]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[15]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[16]  William R. Shadish,et al.  Need-Based Evaluation Theory: what Do You Need to Know to Do Good Evaluation?: , 1994 .

[17]  A. Michael Huberman,et al.  An expanded sourcebook qualitative data analysis , 1994 .

[18]  Jane Wood,et al.  Joint application development (2. ed.) , 1995 .

[19]  Hock-Hai Teo,et al.  Promoting consensus in small decision making groups , 1995, Inf. Manag..

[20]  Denise Silver,et al.  Joint Application Development , 1995 .

[21]  Thomas L. Saaty,et al.  Decision making with dependence and feedback : the analytic network process : the organization and prioritization of complexity , 1996 .

[22]  Barbara Kitchenham,et al.  DESMET: a methodology for evaluating software engineering methods and tools , 1997 .

[23]  Adel Guitouni,et al.  Tentative guidelines to help choosing an appropriate MCDA method , 1998, Eur. J. Oper. Res..

[24]  Stelios H. Zanakis,et al.  Multi-attribute decision making: A simulation comparison of select methods , 1998, Eur. J. Oper. Res..

[25]  Fred Cohen,et al.  Simulating cyber attacks, defences, and consequences , 1999, Comput. Secur..

[26]  Marta Lopez,et al.  An Evaluation Theory Perspective of the Architecture Tradeoff Analysis Method (ATAM) , 2000 .

[27]  Natalia Juristo Juzgado,et al.  A more rigorous and comprehensive approach to software process assessment , 2000, Softw. Process. Improv. Pract..

[28]  Graeme G. Shanks,et al.  Improving the quality of data models: empirical validation of a quality management framework , 2003, Inf. Syst..

[29]  Gwo-Hshiung Tzeng,et al.  Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS , 2004, Eur. J. Oper. Res..

[30]  Teresa Foo,et al.  : SYSTEMATIC LITERATURE REVIEW , 2004 .

[31]  Eva Ocelíková,et al.  Multi-criteria decision making methods , 2005 .

[32]  Gwo-Hshiung Tzeng,et al.  A soft computing method for multi-criteria decision making with dependence and feedback , 2006, Appl. Math. Comput..

[33]  Pearl Brereton,et al.  Performing systematic literature reviews in software engineering , 2006, ICSE.

[34]  Mark Staples,et al.  Experiences using systematic review guidelines , 2006, J. Syst. Softw..

[35]  Aaron Weiss.  Computing in the clouds , 2007, NTWK.

[36]  W. Deng.  Fuzzy importance‐performance analysis for determining critical service attributes , 2008 .

[37]  P. Hansen,et al.  A new method for scoring additive multi‐attribute value models using pairwise rankings of alternatives , 2008 .

[38]  Huan Neng Chiu,et al.  Vendor selection by integrated fuzzy MCDM techniques with independent and interdependent relationships , 2008, Inf. Sci..

[39]  Nicolaus Heereman von Zuydtwyck,et al.  Make-or-Buy im Cloud-Computing: Ein entscheidungsorientiertes Modell für den Bezug von Amazon Web Services , 2009 .

[40]  Gwo-Hshiung Tzeng,et al.  A VIKOR-Based Multiple Criteria Decision Method for Improving Information Security Risk , 2009, Int. J. Inf. Technol. Decis. Mak..

[41]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[42]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[43]  Shrikant Mulik,et al.  An Approach for Selecting Software-as-a-Service (SaaS) Product , 2009, 2009 IEEE International Conference on Cloud Computing.

[44]  Schahram Dustdar,et al.  An End-to-End Approach for QoS-Aware Service Composition , 2009, 2009 IEEE International Enterprise Distributed Object Computing Conference.

[45]  Eui-nam Huh,et al.  Efficient service recommendation system for cloud computing market , 2009, ICIS.

[46]  W. Tsai,et al.  AN EFFECTIVE EVALUATION MODEL AND IMPROVEMENT ANALYSIS FOR NATIONAL PARK WEBSITES: A CASE STUDY OF TAIWAN , 2010 .

[47]  Chen-Fang Tsai,et al.  Service Selection Based on Fuzzy TOPSIS Method , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[48]  Chen-Tung Chen,et al.  A decision-making method based on interval-valued fuzzy sets for cloud service evaluation , 2010, 4th International Conference on New Trends in Information Science and Service Science.

[49]  Khaled M. Khan,et al.  Establishing Trust in Cloud Computing , 2010, IT Professional.

[50]  Raouf Boutaba,et al.  Assessing Software Service Quality and Trustworthiness at Selection Time , 2010, IEEE Transactions on Software Engineering.

[51]  Xiaowei Yang,et al.  CloudCmp: comparing public cloud providers , 2010, IMC '10.

[52]  Zibin Zheng,et al.  Distributed QoS Evaluation for Real-World Web Services , 2010, 2010 IEEE International Conference on Web Services.

[53]  Yongchang Li,et al.  An Intelligent Multi-Criteria Decision Support System for Systems Design , 2010 .

[54]  Alexandru Iosup,et al.  On the Performance Variability of Production Cloud Services , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[55]  Xiaoying Bai,et al.  Evaluating services on the cloud using ontology QoS model , 2011, Proceedings of 2011 IEEE 6th International Symposium on Service Oriented System (SOSE).

[56]  Shankar Chakraborty,et al.  Selection of non-traditional machining processes using analytic network process , 2011 .

[57]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[58]  Rajkumar Buyya,et al.  A Taxonomy of QoS Management and Service Selection Methodologies for Cloud Computing , 2011 .

[59]  G. Nie,et al.  Evaluation Index System of Cloud Service and the Purchase Decision- Making Process Based on AHP , 2011 .

[60]  Farookh Khadeer Hussain,et al.  Towards Multi-criteria Cloud Service Selection , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[61]  Soo Dong Kim,et al.  A Reusability Evaluation Suite for Cloud Services , 2011, 2011 IEEE 8th International Conference on e-Business Engineering.

[62]  Prasad Saripalli,et al.  MADMAC: Multiple Attribute Decision Methodology for Adoption of Clouds , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[63]  Chen Yiming,et al.  SaaS Vendor Selection Basing on Analytic Hierarchy Process , 2011, 2011 Fourth International Joint Conference on Computational Sciences and Optimization.

[64]  Jun-Der Leu,et al.  An effectiveness evaluation model for the web-based marketing of the airline industry , 2011, Expert Syst. Appl..

[65]  Gwo-Hshiung Tzeng,et al.  Evaluating Cloud Computing Based Telecommunications Service Quality Enhancement by Using a New Hybrid MCDM Model , 2012 .

[66]  Carlos Costa,et al.  Cloud services evaluation framework , 2012, OSDOC '12.

[67]  K. K. F. Yuen,et al.  Software-as-a-Service evaluation in cloud paradigm: Primitive cognitive network process approach , 2012, 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2012).

[68]  YoungJae Song,et al.  Relative Weight Decision of Qualiy Attributes in Cloud Computing Service Using ANP , 2012 .

[69]  Farookh Khadeer Hussain,et al.  Iaas Cloud Selection using MCDM Methods , 2012, 2012 IEEE Ninth International Conference on e-Business Engineering.

[70]  Zhiling Guo,et al.  A Fuzzy Logic Multi-criteria Decision Framework for Selecting IT Service Providers , 2012, 2012 45th Hawaii International Conference on System Sciences.

[71]  Frank Teuteberg,et al.  Decision-making in cloud computing environments: A cost and risk based approach , 2011, Information Systems Frontiers.

[72]  Nelly Condori-Fernández,et al.  Lessons learned from evaluating a checklist for reporting experimental and observational research , 2012, Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement.

[73]  Gwo-Hshiung Tzeng,et al.  Brand marketing for creating brand value based on a MCDM model combining DEMATEL with ANP and VIKOR methods , 2012, Expert Syst. Appl..

[74]  Shawish Ahmed,et al.  Integrated QoS Utility-Based Model for Cloud Computing Service Provider Selection , 2012, 2012 IEEE 36th Annual Computer Software and Applications Conference Workshops.

[75]  Gwo-Hshiung Tzeng,et al.  Improving cloud computing service in fuzzy environment — Combining fuzzy DANP and fuzzy VIKOR with a new hybrid FMCDM model , 2012, 2012 International conference on Fuzzy Theory and Its Applications (iFUZZY2012).

[76]  Chinyao Low,et al.  Criteria for the Evaluation of a Cloud-Based Hospital Information System Outsourcing Provider , 2012, Journal of Medical Systems.

[77]  Jörn Kuhlenkamp,et al.  Cloud Service Selection Based on Variability Modeling , 2012, ICSOC.

[78]  Hwa-Young Jeong,et al.  The QoS-based MCDM system for SaaS ERP applications with Social Network , 2012, The Journal of Supercomputing.

[79]  Elijah Blessing Rajsingh,et al.  Efficient Service Selection Middleware using ELECTRE Methodology for Cloud Environments , 2012 .

[80]  Shahzad Nizamani,et al.  A Quality-Aware Computational Cloud Service for Computational Modellers , 2013 .

[81]  Gwo-Hshiung Tzeng,et al.  A VIKOR technique based on DEMATEL and ANP for information security risk control assessment , 2013, Inf. Sci..

[82]  Liam O'Brien,et al.  Evaluation of Commercial Cloud Services : A Systematic Literature Review , 2018 .

[83]  Peter Buxmann,et al.  Evaluating Cloud Services Using Methods of Supplier Selection , 2013, BIS.

[84]  Claus Pahl,et al.  Cloud Migration Research: A Systematic Review , 2013, IEEE Transactions on Cloud Computing.

[85]  Zibin Zheng,et al.  Collaborative Web Service QoS Prediction via Neighborhood Integrated Matrix Factorization , 2013, IEEE Transactions on Services Computing.

[86]  João Carlos Lourenço,et al.  Evaluating Cloud Services Using a Multiple Criteria Decision Analysis Approach , 2013, ICSOC.

[87]  Ahmad Kamil Mahmood,et al.  Review on cloud service evaluation and selection methods , 2013, 2013 International Conference on Research and Innovation in Information Systems (ICRIIS).

[88]  Anne H. H. Ngu,et al.  Cloud Armor: a platform for credibility-based trust management of cloud services , 2013, CIKM.

[89]  Gregoris Mentzas,et al.  Managing Imprecise Criteria in Cloud Service Ranking with a Fuzzy Multi-criteria Decision Making Method , 2013, ESOCC.

[90]  Ahmad Kamil Mahmood,et al.  Trust -Based Service Selection in Public Cloud Computing Using Fuzzy Modified VIKOR Method , 2013 .

[91]  Rajkumar Buyya,et al.  A framework for ranking of cloud computing services , 2013, Future Gener. Comput. Syst..

[92]  Paris Avgeriou,et al.  Variability in quality attributes of service-based software systems: A systematic literature review , 2013, Inf. Softw. Technol..

[93]  Mehmet A. Orgun,et al.  Cloud Service Selection Based on the Aggregation of User Feedback and Quantitative Performance Assessment , 2013, 2013 IEEE International Conference on Services Computing.

[94]  Yi Peng,et al.  A framework for SaaS software packages evaluation and selection with virtual team and BOCR of analytic network process , 2013, The Journal of Supercomputing.

[95]  Haralambos Mouratidis,et al.  A framework to support selection of cloud providers based on security and privacy requirements , 2013, J. Syst. Softw..

[96]  Xiaofei Xu,et al.  Consumer-Centered Cloud Services Selection Using AHP , 2013, 2013 International Conference on Service Sciences (ICSS).

[97]  Farookh Khadeer Hussain,et al.  Parallel Cloud Service Selection and Ranking Based on QoS History , 2014, International Journal of Parallel Programming.

[98]  Shanlin Yang,et al.  A novel two-stage model for cloud service trustworthiness evaluation , 2014, Expert Syst. J. Knowl. Eng..

[99]  N Ramachandran,et al.  Selecting a suitable Cloud Computing technology deployment model for an academic institute , 2014 .

[100]  Liu Yang,et al.  User feature-aware trustworthiness measurement of cloud services via evidence synthesis for potential users , 2014, J. Vis. Lang. Comput..

[101]  Shijin Yuan,et al.  QoS-Aware Cloud Service Selection Based on Uncertain User Preference , 2014, RSKT.

[102]  Hwa-Young Jeong,et al.  Quality evaluation and best service choice for cloud computing based on user preference and weights of attributes using the analytic network process , 2014, Electron. Commer. Res..

[103]  Salima Benbernou,et al.  DBaaS-Expert: A Recommender for the Selection of the Right Cloud Database , 2014, ISMIS.

[104]  Yanchun Zhang,et al.  Multicriteria decision making with fuzziness and criteria interdependence in cloud service selection , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[105]  Elizabeth Chang,et al.  Cloud service selection: State-of-the-art and future research directions , 2014, J. Netw. Comput. Appl..

[106]  Li Lin,et al.  A privacy-aware cloud service selection method toward data life-cycle , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[107]  Mohamed F. Tolba,et al.  Cloud Services Discovery and Selection: Survey and New Semantic-Based System , 2014, Bio-inspiring Cyber Security and Cloud Services.

[108]  Youcef Aklouf,et al.  An Approach based on user preferences for selecting SaaS product , 2014, 2014 International Conference on Multimedia Computing and Systems (ICMCS).

[109]  Qunying Huang,et al.  A Service Brokering and Recommendation Mechanism for Better Selecting Cloud Services , 2014, PloS one.

[110]  Harry G. Perros,et al.  A novel trust management framework for multi-cloud environments based on trust service providers , 2014, Knowl. Based Syst..

[111]  Abdellah Idrissi,et al.  Introduction of an outranking method in the Cloud computing research and Selection System based on the Skyline , 2014, 2014 IEEE Eighth International Conference on Research Challenges in Information Science (RCIS).

[112]  Nor Badrul Anuar,et al.  Cloud Service Selection Using Multicriteria Decision Analysis , 2014, TheScientificWorldJournal.

[113]  Rajiv Ranjan,et al.  Fuzzy cloud service selection framework , 2014, 2014 IEEE 3rd International Conference on Cloud Networking (CloudNet).

[114]  Neeraj Suri,et al.  AHP-Based Quantitative Approach for Assessing and Comparing Cloud Security , 2014, 2014 IEEE 13th International Conference on Trust, Security and Privacy in Computing and Communications.

[115]  Changyong Liang,et al.  Combining QoS prediction and customer satisfaction estimation to solve cloud service trustworthiness evaluation problems , 2014, Knowl. Based Syst..

[116]  Amin Jula,et al.  Cloud computing service composition: A systematic literature review , 2014, Expert Syst. Appl..

[117]  Vehbi C. Gungor,et al.  Performance evaluation of cloud computing platforms using statistical methods , 2014, Comput. Electr. Eng..

[118]  Flávio R. C. Sousa,et al.  Assessing cloud computing SaaS adoption for enterprise applications using a Petri net MCDM framework , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[119]  Jinjun Chen,et al.  CloudGenius: A Hybrid Decision Support Method for Automating the Migration of Web Application Clusters to Public Clouds , 2015, IEEE Transactions on Computers.

[120]  Victor Muntés-Mulero,et al.  Risk-Driven Framework for Decision Support in Cloud Service Selection , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[121]  Bram Naudts,et al.  Modeling legal and regulative requirements for ranking alternatives of cloud-based services , 2015, 2015 IEEE Eighth International Workshop on Requirements Engineering and Law (RELAW).

[122]  Shitong Zhu,et al.  On selecting composite network-cloud services: a quality-of-service based approach , 2015, RACS.

[123]  Jyothi Shetty,et al.  Quality of service driven cloud service ranking and selection algorithm using REMBRANDT approach , 2015, 2015 International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM).

[124]  Gregoris Mentzas,et al.  PuLSaR: preference-based cloud service selection for cloud service brokers , 2015, Journal of Internet Services and Applications.

[125]  Usman Qamar,et al.  Towards Service Evaluation and Ranking Model for Cloud Infrastructure Selection , 2015, 2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom).

[126]  Youcef Aklouf,et al.  Evaluation and selection of SaaS product based on user preferences , 2015, 2015 Third International Conference on Technological Advances in Electrical, Electronics and Computer Engineering (TAEECE).

[127]  Farookh Khadeer Hussain,et al.  User-side cloud service management: State-of-the-art and future directions , 2015, J. Netw. Comput. Appl..

[128]  Xiaolin Cheng.  Cloud computing decision-making using a fuzzy AHP approach , 2015 .

[129]  Pascal Bouvry,et al.  An Evaluation Model for Selecting Cloud Services from Commercially Available Cloud Providers , 2015, 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom).

[130]  Yi Zhuang,et al.  Fuzzy trust evaluation based on consistency intensity for cloud services , 2015, Kybernetes.

[131]  Imran Ghani,et al.  Quality of service approaches in cloud computing: A systematic mapping study , 2015, J. Syst. Softw..

[132]  Thomas L. Saaty,et al.  When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods , 2015, Int. J. Inf. Technol. Decis. Mak..

[133]  Yanchun Zhang,et al.  Cloud-FuSeR: Fuzzy ontology and MCDM based cloud service selection , 2016, Future Gener. Comput. Syst..

[134]  Rajib Mall,et al.  A cognitive approach for evaluating the usability of Storage as a Service in Cloud Computing Environment , 2016 .

[135]  Ognjen Pantelic,et al.  General Model for Adequate Cloud Service Selection using Decision Making Methods , 2016, Int. J. Comput. Commun. Control.

[136]  S. Wibowo,et al.  Evaluating the Performance of Cloud Services: A Fuzzy Multicriteria Group Decision Making Approach , 2016, 2016 International Symposium on Computer, Consumer and Control (IS3C).

[137]  Wattana Viriyasitavat,et al.  Multi-criteria selection for services selection in service workflow , 2016 .

[138]  Tsai-Hua Kang,et al.  The study for selecting the cloud service consignment performance in group decision of shared sales resource , 2016, 2016 International Conference on Applied System Innovation (ICASI).

[139]  P. K. Kapur,et al.  Selecting appropriate cloud solution for managing big data projects using hybrid AHP-entropy based assessment , 2016, 2016 International Conference on Innovation and Challenges in Cyber Security (ICICCS-INBUSH).

[140]  Sen Liu,et al.  Decision making for the selection of cloud vendor: An improved approach under group decision-making with integrated weights and objective/subjective attributes , 2016, Expert Syst. Appl..

[141]  Thiruselvan Subramanian,et al.  Cloud Service Evaluation and Selection Using Fuzzy Hybrid MCDM Approach in Marketplace , 2016, Int. J. Fuzzy Syst. Appl..

[142]  Rajanpreet Kaur Chahal,et al.  AHP-Based Ranking of Cloud-Service Providers , 2016 .

[143]  Sarbjeet Singh,et al.  Improved TOPSIS Method Based Trust Evaluation Framework for Determining Trustworthiness of Cloud Service Providers , 2017, Journal of Grid Computing.

[144]  R. Shanmugalakshmi,et al.  Parameters and methods used to evaluate cloud service providers: A survey , 2016, 2016 International Conference on Computer Communication and Informatics (ICCCI).

[145]  Sangwon Lee,et al.  A Hybrid Multi-Criteria Decision-Making Model for a Cloud Service Selection Problem Using BSC, Fuzzy Delphi Method and Fuzzy AHP , 2016, Wirel. Pers. Commun..

[146]  Mengxiang Li,et al.  Cloud computing adoption decision modelling for SMEs: From the PAPRIKA perspective , 2016 .

[147]  Nima Jafari Navimipour,et al.  Cloud services recommendation: Reviewing the recent advances and suggesting the future research directions , 2017, J. Netw. Comput. Appl..

[148]  Sarbjeet Singh,et al.  Compliance-based Multi-dimensional Trust Evaluation System for determining trustworthiness of Cloud Service Providers , 2017, Future Gener. Comput. Syst..

[149]  A. Idrissi.  Skyline in Cloud Computing , .