A systematic literature review and critical assessment of model-driven decision support for IT outsourcing

Information technology outsourcing (ITO) is a widely-adopted strategy for IT governance. The decisions involved in IT outsourcing are complicated. Empirical research confirms that a rational and formalized decision-making process results in better decision outcomes. However, formal and systematic approaches for making ITO decisions appear to be scarce in practice. To support organizational decision-makers involved in IT outsourcing (including cloud sourcing), researchers have suggested several decision support methods. To date there is no comprehensive review and assessment of the research in this domain. In this study 133 model-driven decision support research articles for IT outsourcing and cloud sourcing were identified through a systematic literature review and assessed based on a highly-regarded research framework. An analysis of these 133 research articles suggested a range of Multiple Criteria Decision Making (MCDM), optimization and simulation methods to support different IT outsourcing decisions. Our findings raise concerns about the limited use of reference design theories, and the lack of validation and naturalistic evaluation of the decision support artifacts reported in ITO decision support literature. Based on the review, we provide future research directions, as well as a number of recommendations to enhance the rigor and relevance of ITO Decision Support Systems research. IT sourcing decision support researchers adopted diverse decision analysis methods.Use of naturalistic evaluation & reference theories is limited in IT sourcing research.Recommendation for development of IT sourcing decision support artifacts presented.

[1]  Abraham Charnes,et al.  Optimal Estimation of Executive Compensation by Linear Programming , 1955 .

[2]  Basar Öztaysi,et al.  A decision model for information technology selection using AHP integrated TOPSIS-Grey: The case of content management systems , 2014, Knowl. Based Syst..

[3]  Farookh Khadeer Hussain,et al.  Towards Multi-criteria Cloud Service Selection , 2011, 2011 Fifth International Conference on Innovative Mobile and Internet Services in Ubiquitous Computing.

[4]  Jacky W. Keung,et al.  Cloud Deployment Model Selection Assessment for SMEs: Renting or Buying a Cloud , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[5]  Gülçin Büyüközkan,et al.  An Intelligent Decision Support System for IT Outsourcing , 2006, FSKD.

[6]  Jan Pries-Heje,et al.  A Comprehensive Framework for Evaluation in Design Science Research 1 , 2022 .

[7]  Yajiong Xue,et al.  IT outsourcing research from 1992 to 2013: A literature review based on main path analysis , 2016, Inf. Manag..

[8]  Paul Karänke,et al.  A Risk-Aware Decision Model for Service Sourcing (Short Paper) , 2013, 2013 IEEE 6th International Conference on Service-Oriented Computing and Applications.

[9]  Jie Cao,et al.  A hybrid model using analytic network process and gray relational analysis for bank's IT outsourcing vendor selection , 2012, Kybernetes.

[10]  G. Erber,et al.  Offshore Outsourcing , 2005 .

[11]  O. J. Akomode,et al.  Constructing customised models and providing information to support IT outsourcing decisions , 1998 .

[12]  Simon Shiu,et al.  Migration to Cloud as Real Option: Investment Decision under Uncertainty , 2011, 2011IEEE 10th International Conference on Trust, Security and Privacy in Computing and Communications.

[13]  Rajiv Kishore,et al.  An investigation of factors that influence the duration of IT outsourcing relationships , 2007, Decis. Support Syst..

[14]  Lawrence Loh,et al.  Diffusion of Information Technology Outsourcing: Influence Sources and the Kodak Effect , 1992, Inf. Syst. Res..

[15]  Xi Chen,et al.  A novel IS/IT outsourcing service vendor selection method based on fuzzy axiomatic design , 2011, 2011 IEEE 18th International Conference on Industrial Engineering and Engineering Management.

[16]  P. Keen.  Value Analysis: Justifying Decision Support Systems , 1993 .

[17]  James B. Davis.  Insights from a Real Options Approach to Evaluate IT Sourcing Decisions , 2005, AMCIS.

[18]  Ray Hackney,et al.  IT outsourcing: frameworks for conceptualizing practice and perception , 2000, Inf. Syst. J..

[19]  Frank Teuteberg,et al.  A Decision Model for the Evaluation and Selection of Cloud Computing Services: A First Step Towards a More Sustainable Perspective , 2015, Int. J. Inf. Technol. Decis. Mak..

[20]  Shah Jahan Miah,et al.  A development-oriented DSS evaluation approach: A case demonstration for conceptual assessment , 2012 .

[21]  L. Willcocks,et al.  IT outsourcing as strategic partnering: the case of the UK Inland Revenue , 1998, European Conference on Information Systems.

[22]  Ian Sommerville,et al.  Decision Support Tools for Cloud Migration in the Enterprise , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[23]  A. Ansarinejad,et al.  A Practical Framework for IS Outsourcing Using the Integrated Fuzzy Group Decision Making Approach , 2010, 2010 Second International Conference on Computational Intelligence, Modelling and Simulation.

[24]  Zhiling Guo,et al.  A Fuzzy Logic Multi-criteria Decision Framework for Selecting IT Service Providers , 2012, 2012 45th Hawaii International Conference on System Sciences.

[25]  A. Charnes,et al.  Management Models and Industrial Applications of Linear Programming , 1961 .

[26]  Ramesh Sharda,et al.  Model-driven decision support systems: Concepts and research directions , 2007, Decis. Support Syst..

[27]  Xin Zhou,et al.  Process-oriented software outsourcing decision based on genetic algorithm , 2010, Proceedings of 2010 IEEE International Conference on Service Operations and Logistics, and Informatics.

[28]  Lazar Rusu,et al.  A Software Tool that Supports Decisions for Companies to Outsource Information Technology or not , 2007, MCIS.

[29]  Chitu Okoli,et al.  A Guide to Conducting a Standalone Systematic Literature Review , 2015, Commun. Assoc. Inf. Syst..

[30]  Kristian Beckers,et al.  Trust-Aware Decision-Making Methodology for Cloud Sourcing , 2014, CAiSE.

[31]  Zahir Irani,et al.  The Relationship Advantage: Information Technologies, Sourcing, and Management , 2003, Eur. J. Inf. Syst..

[32]  Peter C. Fishburn,et al.  Letter to the Editor - Additive Utilities with Incomplete Product Sets: Application to Priorities and Assignments , 1967, Oper. Res..

[33]  Ian Sommerville,et al.  The Cloud Adoption Toolkit: supporting cloud adoption decisions in the enterprise , 2010, Softw. Pract. Exp..

[34]  Elijah Blessing Rajsingh,et al.  Efficient Service Selection Middleware using ELECTRE Methodology for Cloud Environments , 2012 .

[35]  P. S. Lokachari,et al.  Outsourcing of information technology services: a decision-making framework , 2001, PICMET '01. Portland International Conference on Management of Engineering and Technology. Proceedings Vol.1: Book of Summaries (IEEE Cat. No.01CH37199).

[36]  Amit Jain,et al.  Knowledge based transactions and decision framing in Information Technology Outsourcing , 2013, J. Strateg. Inf. Syst..

[37]  Alan R. Hevner,et al.  A Fitness-Utility Model for Design Science Research , 2011, DESRIST.

[38]  Sebastian K. Boell,et al.  Debating systematic literature reviews (SLR) and their ramifications for IS: a rejoinder to Mike Chiasson, Briony Oates, Ulrike Schultze, and Richard Watson , 2015, J. Inf. Technol..

[39]  Shu-Ping Wan,et al.  Fuzzy heterogeneous multiattribute decision making method for outsourcing provider selection , 2014, Expert Syst. Appl..

[40]  Shuai Ding,et al.  Decision Support for Personalized Cloud Service Selection through Multi-Attribute Trustworthiness Evaluation , 2014, PloS one.

[41]  Yanzhen Qu,et al.  A Holistic Model for Making Cloud Migration Decision: A Consideration of Security, Architecture and Business Economics , 2012, 2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications.

[42]  Yanchun Zhang,et al.  A Hybrid Fuzzy Framework for Cloud Service Selection , 2014, 2014 IEEE International Conference on Web Services.

[43]  Gregory Mahr.  Validation , 2019, Academic Psychiatry.

[44]  Bertrand Quelin,et al.  Outsourcing Failure and Reintegration: The Influence of Contractual and External Factors , 2012 .

[45]  Rui Qiang,et al.  AN INHOMOGENEOUS MULTI-ATTRIBUTE DECISION MAKING METHOD AND APPLICATION TO IT/IS OUTSOURCING PROVIDER SELECTION , 2015 .

[46]  Osman Balci,et al.  Validation of Expert System Performance , 1986 .

[47]  Shirley Gregor,et al.  The Anatomy of a Design Theory , 2007, J. Assoc. Inf. Syst..

[48]  M. P. Gupta,et al.  Deciding the level of information systems outsourcing: Proposing a framework and validation with three Indian banks , 2011, J. Enterp. Inf. Manag..

[49]  Denis Borenstein,et al.  Towards a practical method to validate decision support systems , 1998, Decis. Support Syst..

[50]  Mamata Jenamani,et al.  Risk assessment of outsourcing e-procurement services: integrating SWOT analysis with a modified ANP-based fuzzy inference system , 2016 .

[51]  Leslie P. Willcocks,et al.  A review of the IT outsourcing empirical literature and future research directions , 2010, J. Inf. Technol..

[52]  Zheng-Kui Lin,et al.  A Decision Model for IS Outsourcing Based on AHP and ELECTREIII , 2008, 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing.

[53]  Santoso Wibowo,et al.  Performance evaluation of cloud computing providers using fuzzy multiattribute group decision making model , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[54]  John R. Venable,et al.  A framework for Design Science research activities , 2006 .

[55]  Kweku-Muata Osei-Bryson,et al.  Making the information systems outsourcing decision: A transaction cost approach to analyzing outsourcing decision problems , 1999, Eur. J. Oper. Res..

[56]  Markus Lilienthal,et al.  A Decision Support Model for Cloud Bursting , 2013, Business & Information Systems Engineering.

[57]  Jonas Repschläger,et al.  Cloud service management decision support: An application of AHP for provider selection of a cloud-based IT service management system , 2014, Intell. Decis. Technol..

[58]  Godwin G. Udo.  Using analytic hierarchy process to analyze the information technology outsourcing decision , 2000, Ind. Manag. Data Syst..

[59]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[60]  Rajkumar Buyya,et al.  A framework for ranking of cloud computing services , 2013, Future Gener. Comput. Syst..

[61]  Osman Balci,et al.  Validating Expert System Performance , 1987, IEEE Expert.

[62]  Kristi Jackson,et al.  Qualitative Data Analysis with NVivo , 2007 .

[63]  Chinyao Low,et al.  Criteria for the Evaluation of a Cloud-Based Hospital Information System Outsourcing Provider , 2012, Journal of Medical Systems.

[64]  S. V. Razumnikov,et al.  Decision support system of transition IT-applications in the cloud enviroment , 2015, 2015 International Siberian Conference on Control and Communications (SIBCON).

[65]  L. Willcocks,et al.  Interpreting information technology sourcing decisions from a transaction cost perspective: Findings and critique , 1995 .

[66]  Guan Zhong-liang,et al.  Study on a Decision Model of IT OutsourcingPrioritization , 2006 .

[67]  Walter Brisken,et al.  To Lease or Not to Lease from Storage Clouds , 2010, Computer.

[68]  Gary Klein,et al.  Rental software valuation in IT investment decisions , 2004, Decis. Support Syst..

[69]  Marten Schönherr,et al.  (MC2)2: criteria, requirements and a software prototype for Cloud infrastructure decisions , 2013, Softw. Pract. Exp..

[70]  Chia-Wei Chang,et al.  Probability-Based Cloud Storage Providers Selection Algorithms with Maximum Availability , 2012, 2012 41st International Conference on Parallel Processing.

[71]  Herbert A. Simon.  The new science of management decision. , 1960 .

[72]  E. Zavadskas,et al.  Multiple criteria decision making (MCDM) methods in economics: an overview , 2011 .

[73]  Tommi Kramer,et al.  Outsourcing Decisions of Small and Medium-Sized Enterprises: A Multiple-Case Study Approach in the German Software Industry , 2013, 2013 46th Hawaii International Conference on System Sciences.

[74]  Yanchun Zhang,et al.  Multicriteria decision making with fuzziness and criteria interdependence in cloud service selection , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[75]  H. Raghav Rao,et al.  Management of Information Systems Outsourcing: A Bidding Perspective , 1995, J. Manag. Inf. Syst..

[76]  Wenhui Liu,et al.  A Multi-criteria Decision Making Method Based on Linguistic Preference Information for IT Outsourcing Vendor Selection in Hospitals , 2013 .

[77]  Graham Pervan,et al.  Eight key issues for the decision support systems discipline , 2008, Decis. Support Syst..

[78]  Tzu-Chuan Chou,et al.  Design and implementation of an ontology-based information technology outsourcing evaluation system using AHP , 2007 .

[79]  Bartlomiej Hanus,et al.  Multidimensional Decision Model for Investment in Cloud Computing , 2013, AMCIS.

[80]  F. Chervenak,et al.  Authors' reply re: BJOG Debate ‘Home birth is unsafe’ , 2016, BJOG : an international journal of obstetrics and gynaecology.

[81]  Frank Teuteberg,et al.  Decision-making in cloud computing environments: A cost and risk based approach , 2011, Information Systems Frontiers.

[82]  Faramak Zandi,et al.  A bi-level constraint-oriented outsourcing framework for orchestration of an ERP system , 2014 .

[83]  P. Finlay.  Introducing Decision Support Systems , 1994 .

[84]  Ibrahim Sogukpinar,et al.  Scalable risk assessment method for cloud computing using game theory (CCRAM) , 2015, Comput. Stand. Interfaces.

[85]  Thomas Hess,et al.  Setting targets right! how non-rational biases affect the risk preference of it-outsourcing decision makers - an empirical investigation , 2011, ECIS.

[86]  Rouhshi Low,et al.  Cloud Computing: How does it differ from IT outsourcing and what are the implications for practice and research? , 2013 .

[87]  Thomas F. Stafford.  Active Priming of Cultural Stereotypes In Outsourcing Decision Making , 2011 .

[88]  N Ramachandran,et al.  Selecting a suitable Cloud Computing technology deployment model for an academic institute , 2014 .

[89]  Björn Niehaves,et al.  Standing on the Shoulders of Giants: Challenges and Recommendations of Literature Search in Information Systems Research , 2015, Commun. Assoc. Inf. Syst..

[90]  Anderson Santana de Oliveira,et al.  A Cloud Adoption Risk Assessment Model , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[91]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[92]  Alberto S. Lima,et al.  A system dynamics model to support strategic decision making on IT outsourcing: A case study at a state revenue agency in Brazil , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[93]  Farookh Khadeer Hussain,et al.  User-side cloud service management: State-of-the-art and future directions , 2015, J. Netw. Comput. Appl..

[94]  Bo Feng,et al.  Identifying risk factors of IT outsourcing using interdependent information: An extended DEMATEL method , 2012, Expert Syst. Appl..

[95]  Cengiz Kahraman,et al.  Information systems outsourcing decisions using a group decision-making approach , 2009, Eng. Appl. Artif. Intell..

[96]  Tien-Chin Wang,et al.  Optimizing partners’ choice in IS/IT outsourcing projects: The strategic decision of fuzzy VIKOR , 2009 .

[97]  Graham Pervan,et al.  An assessment of DSS design science using the Hevner, March, Park, and Ram guidelines. , 2008 .

[98]  Leon A. de Looff,et al.  Information systems outsourcing decision making: a framework organizational theories and case studies , 1995, J. Inf. Technol..

[99]  Dorret I. Boomsma,et al.  Identifying Genetic Variants for Heart Rate Variability in the Acetylcholine Pathway , 2014, PloS one.

[100]  Sheng-Wei Lin,et al.  The critical success factors for a travel application service provider evaluation and selection by travel intermediaries , 2016 .

[101]  Lotfi A. Zadeh,et al.  The concept of a linguistic variable and its application to approximate reasoning-III , 1975, Inf. Sci..

[102]  Jinlong Zhang,et al.  A Fuzzy Rough Group Decision-making Model for Rating and Ranking IT Outsourcing Aggressive Risk , 2006, 2006 International Conference on Service Systems and Service Management.

[103]  Thomas L. Saaty,et al.  Decision making for leaders , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[104]  Michael J. Shaw,et al.  A MCDM approach for sourcing strategy mix decision in IT projects , 2010, Expert Syst. Appl..

[105]  Boonlert Watjatrakul,et al.  Determinants of IS sourcing decisions: A comparative study of transaction cost theory versus the resource-based view , 2005, J. Strateg. Inf. Syst..

[106]  Guy Paré,et al.  Synthesizing information systems knowledge: A typology of literature reviews , 2015, Inf. Manag..

[107]  Jean Pierre Brans,et al.  HOW TO SELECT AND HOW TO RANK PROJECTS: THE PROMETHEE METHOD , 1986 .

[108]  Saeed Tajdini,et al.  IS Outsourcing Decision: A Quantitative Approach , 2012 .

[109]  Jianguo Zheng,et al.  A Model for Offshore Information Systems Outsourcing Provider Selection in Developing Countries , 2015 .

[110]  Veena Bansal,et al.  A Decision-Making Framework for IT Outsourcing using the Analytic Hierarchy Process , 2003 .

[111]  Henrique Rego,et al.  IT Services Management and ISO 20000: A Case Study in an IT Remote Support Company , 2014 .

[112]  Deo Prakash Vidyarthi,et al.  A framework for selection of best cloud service provider using ranked voting method , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[113]  Suzanne Rivard,et al.  Firm strategic profile and IT outsourcing , 2008, Inf. Syst. Frontiers.

[114]  Sandeep Purao,et al.  Evaluating the adoption potential of design science efforts: The case of APSARA , 2008, Decis. Support Syst..

[115]  Gang Xie,et al.  The strategic decision of fuzzy TOPSIS on partner' choice in IT outsourcing projects , 2011, 2011 International Conference on Computer Science and Service System (CSSS).

[116]  Bandula Jayatilaka,et al.  Information systems outsourcing: a survey and analysis of the literature , 2004, DATB.

[117]  Anthony Wensley,et al.  Game theory as a tool for understanding information services outsourcing , 1997, J. Inf. Technol..

[118]  James T. C. Teng,et al.  A descriptive study on the outsourcing of information systems functions , 1994, Inf. Manag..

[119]  Cheng-Chieh Huang,et al.  A Dynamic Model of Decision-making in the IS/IT Outsourcing Process: A Case Study from a Government-supported , 2008 .

[120]  Göran Bergström,et al.  Analyzing Text and Discourse: Eight Approaches for the Social Sciences , 2017 .

[121]  Claudia Löbbecke,et al.  Development of a model-based netsourcing decision support system using a five-stage methodology , 2009, Eur. J. Oper. Res..

[122]  Thomas L. Saaty,et al.  The Analytic Network Process: Decision Making With Dependence and Feedback , 2001 .

[123]  L. Willcocks,et al.  The Value of Selective IT Sourcing , 1996 .

[124]  James S. Collofello,et al.  System dynamics modeling applied to software outsourcing decision support , 2000 .

[125]  Ronald A. Howard,et al.  The Foundations of Decision Analysis , 1968, IEEE Trans. Syst. Sci. Cybern..

[126]  Jatinder N. D. Gupta,et al.  An integrative evaluation framework for intelligent decision support systems , 2009, Eur. J. Oper. Res..

[127]  Mohd. Nishat Faisal,et al.  IT outsourcing intent in academic institutions in GCC countries: An empirical investigation and multi-criteria decision model for vendor selection , 2016, J. Enterp. Inf. Manag..

[128]  Alessio Ishizaka,et al.  Analytic network process , 2013 .

[129]  José L. Gascó,et al.  Information systems outsourcing: A literature analysis , 2006, Inf. Manag..

[130]  Kin Keung Lai,et al.  A Variable Precision Fuzzy Rough Group Decision-Making Model for IT Offshore Outsourcing Risk Evaluation , 2008, J. Glob. Inf. Manag..

[131]  Prashant C. Palvia.  A dialectic view of information systems outsourcing: Pros and cons , 1995, Inf. Manag..

[132]  Marion G. Sobol,et al.  IS outsourcing practices in the USA, Japan and Finland: a comparative study , 1997, J. Inf. Technol..

[133]  Michel Benaroch,et al.  Managing Information Technology Investment Risk: A Real Options Perspective , 2002, J. Manag. Inf. Syst..

[134]  Samarjit Kar,et al.  Strategic Decisions Using Intuitionistic Fuzzy Vikor Method for Information System (IS) Outsourcing , 2013, 2013 International Symposium on Computational and Business Intelligence.

[135]  Kin Keung Lai,et al.  A Group Decision-Making Model of Risk Evasion in Software Project Bidding Based on VPRS , 2005, RSFDGrC.

[136]  Graham Pervan,et al.  A critical analysis of decision support systems research , 2005, J. Inf. Technol..

[137]  Chen Yiming,et al.  SaaS Vendor Selection Basing on Analytic Hierarchy Process , 2011, 2011 Fourth International Joint Conference on Computational Sciences and Optimization.

[138]  J. Bertrand,et al.  Operations management research methodologies using quantitative modeling , 2002 .

[139]  Martin Bichler,et al.  Design science in information systems research , 2006, Wirtschaftsinf..

[140]  Luis G. Vargas,et al.  Firm-level outsourcing decision making: A balanced scorecard-based analytic network process model , 2014 .

[141]  Steffen Zschaler,et al.  InCLOUDer: A Formalised Decision Support Modelling Approach to Migrate Applications to Cloud Environments , 2014, 2014 40th EUROMICRO Conference on Software Engineering and Advanced Applications.

[142]  A. Sohal,et al.  Outsourcing decision-making: does the process matter? , 2016 .

[143]  Christopher P. Muir,et al.  A Decision Making Model for the Adoption of Cloud Computing in Jamaican Organizations , 2013, AMCIS.

[144]  Cengiz Kahraman,et al.  Selection among ERP outsourcing alternatives using a fuzzy multi-criteria decision making methodology , 2010 .

[145]  Ying-Hsiu Chen,et al.  Strategic decisions using the fuzzy PROMETHEE for IS outsourcing , 2011, Expert Syst. Appl..

[146]  Ronan McIvor,et al.  What is the right outsourcing strategy for your process , 2008 .

[147]  Andreas S. Andreou,et al.  A Multilayer Fuzzy Cognitive Maps approach to the cloud adoption decision support problem , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[148]  Jun Xu,et al.  Multiple attribute decision making with triangular intuitionistic fuzzy numbers and application to cloud service provider selection , 2014, Proceedings of 2nd International Conference on Information Technology and Electronic Commerce.

[149]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[150]  Allan D. Shocker,et al.  Linear programming techniques for multidimensional analysis of preferences , 1973 .

[151]  Deli Yang,et al.  Where to Outsource: Using a Hybrid Multi-criteria Decision Aid Method for Selecting an Offshore Outsourcing Location , 2006, AMCIS.

[152]  Bernard Roy,et al.  Classement et choix en présence de points de vue multiples , 1968 .

[153]  Byung Do Chung,et al.  A Cloud Service Selection Model based on Analytic Network Process , 2015 .

[154]  Ying-Hsiu Chen,et al.  Applying Fuzzy PROMETHEE Method for Evaluating IS Outsourcing Suppliers , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[155]  Loretta Mastroeni,et al.  Storage Buy-or-Lease decisions in cloud computing under price uncertainty , 2011, 2011 7th EURO-NGI Conference on Next Generation Internet Networks.

[156]  Tommi Kramer,et al.  Outsourcing Location Selection with SODA: A Requirements Based Decision Support Methodology and Tool , 2013, CAiSE.

[157]  Shanlin Yang,et al.  A novel two-stage model for cloud service trustworthiness evaluation , 2014, Expert Syst. J. Knowl. Eng..

[158]  Vahid Majazi Dalfard,et al.  Information Systems Outsourcing Decisions under Fuzzy Group Decision Making Approach , 2011, Int. J. Inf. Technol. Decis. Mak..

[159]  Claudia Löbbecke,et al.  What drives netsourcing decisions? An empirical analysis , 2006, Eur. J. Inf. Syst..

[160]  Gilbert Fridgen,et al.  An Approach for Portfolio Selection in Multi-Vendor IT Outsourcing , 2011, ICIS.

[161]  She-I Chang,et al.  An analysis of IT/IS outsourcing provider selection for small- and medium-sized enterprises in Taiwan , 2012, Inf. Manag..

[162]  Mehmet A. Orgun,et al.  Cloud Service Selection Based on the Aggregation of User Feedback and Quantitative Performance Assessment , 2013, 2013 IEEE International Conference on Services Computing.

[163]  L. L. Cummings,et al.  Strategic Response to Institutional Influences on Information Systems Outsourcing , 1997 .

[164]  Tinggui Chen,et al.  A Novel Dynamic Algorithm for IT Outsourcing Risk Assessment Based on Transaction Cost Theory , 2015 .

[165]  Basar Oztaysi,et al.  A decision model for information technology selection using AHP integrated TOPSIS-Grey , 2014 .

[166]  Sajal K. Das,et al.  SelCSP: A Framework to Facilitate Selection of Cloud Service Providers , 2015, IEEE Transactions on Cloud Computing.

[167]  J. Meredith,et al.  Alternative research paradigms in operations , 1989 .

[168]  Robert T. Clemen,et al.  Making Hard Decisions with Decisiontools Suite , 2000 .

[169]  Jahyun Goo,et al.  Facilitating relational governance through service level agreements in IT outsourcing: An application of the commitment-trust theory , 2008, Decis. Support Syst..

[170]  Shrikant Mulik,et al.  An Approach for Selecting Software-as-a-Service (SaaS) Product , 2009, 2009 IEEE International Conference on Cloud Computing.

[171]  De-Li Yang,et al.  Using a hybrid multi-criteria decision aid method for information systems outsourcing , 2007, Comput. Oper. Res..

[172]  Pi-Fang Hsu,et al.  Optimizing the Information Outsourcing Practices of Primary Care Medical Organizations Using Entropy and TOPSIS , 2008 .

[173]  K. Yoon.  A Reconciliation Among Discrete Compromise Solutions , 1987 .

[174]  Kweku-Muata Osei-Bryson,et al.  Managing risks in information systems outsourcing: An approach to analyzing outsourcing risks and structuring incentive contracts , 2006, Eur. J. Oper. Res..

[175]  Gwo-Hshiung Tzeng,et al.  Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS , 2004, Eur. J. Oper. Res..

[176]  R. Davison.  Offshoring information technology: Sourcing and outsourcing to a global workforce , 2006, Electron. J. Inf. Syst. Dev. Ctries..

[177]  Tor Guimaraes,et al.  Assessing the quality of institutional DSS , 1995 .

[178]  J. Barthélemy.  The Hidden Costs of IT Outsourcing , 2001 .

[179]  Wai Chi Wong,et al.  A Quantitative model for analysing IS outsourcing decisions , 2006 .

[180]  Joseph W. Rottman,et al.  Global outsourcing of back office services: lessons, trends, and enduring challenges , 2008 .

[181]  John R. Venable,et al.  Design Science Research Post Hevner et al.: Criteria, Standards, Guidelines, and Expectations , 2010, DESRIST.

[182]  Zongjian Tang,et al.  A Game Analysis of Outsourcing Strategy for Enterprise Informatization , 2007, CONFENIS.

[183]  Yuan Li,et al.  A Bayesian Network Model under Group Decision Making for Evaluating IT Outsourcing Risk , 2008, 2008 International Conference on Risk Management & Engineering Management.

[184]  Xiaofei Xu,et al.  Consumer-Centered Cloud Services Selection Using AHP , 2013, 2013 International Conference on Service Sciences (ICSS).

[185]  Ashley A. Bush,et al.  A Comparison of Transaction Cost, Agency, and Knowledge-Based Predictors of IT Outsourcing Decisions: A U.S.-Japan Cross-Cultural Field Study , 2007, J. Manag. Inf. Syst..

[186]  M. Schreier,et al.  Qualitative Content Analysis , 2014 .

[187]  R. McIvor.  A practical framework for understanding the outsourcing process , 2000 .

[188]  David L. Olson,et al.  Evaluation of ERP outsourcing , 2007, Comput. Oper. Res..

[189]  Kwang-Kyu Seo,et al.  A Fuzzy AHP based Multi-criteria Decision-making Model to Select a Cloud Service , 2014 .

[190]  Paul B. Kantor,et al.  Cross-Evaluation: A new model for information system evaluation , 2006, J. Assoc. Inf. Sci. Technol..

[191]  Siba Sankar Mahapatra,et al.  Risk assessment in IT outsourcing using fuzzy decision-making approach: An Indian perspective , 2014, Expert Syst. Appl..

[192]  Desheng Dash Wu,et al.  Multiple Criteria Analysis for Evaluation of Information System Risk , 2011, Asia Pac. J. Oper. Res..

[193]  Ana Paula Cabral Seixas Costa,et al.  Group Decision Model for Outsourcing IT Services , 2014 .

[194]  L. Willcocks,et al.  Netsourcing: Renting Business Applications and Services Over a Network , 2002 .

[195]  Frank Leymann,et al.  Supporting the Migration of Applications to the Cloud through a Decision Support System , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[196]  Mary Lacity,et al.  Cloud Services Practices for Small and Medium-Sized Enterprises , 2014, MIS Q. Executive.

[197]  Fekete Zoltan Alpar,et al.  A SUPPLIER SELECTION MODEL FOR SOFTWARE DEVELOPMENT OUTSOURCING , 2010 .

[198]  Ching-Lai Hwang,et al.  Multiple Attribute Decision Making: Methods and Applications - A State-of-the-Art Survey , 1981, Lecture Notes in Economics and Mathematical Systems.

[199]  Birsen Karpak,et al.  A Case Study Using the Analytic Hierarchy Process for IT Outsourcing Decision Making , 2015, Int. J. Inf. Syst. Supply Chain Manag..

[200]  Leslie P. Willcocks,et al.  A review of the IT outsourcing literature: Insights for practice , 2009, J. Strateg. Inf. Syst..

[201]  Mohd. Nishat Faisal,et al.  Analysing alternatives for information technology outsourcing decision: an analytic network process approach , 2008, Int. J. Bus. Inf. Syst..

[202]  A. Keramati,et al.  A structured methodology for Information Systems Outsourcing Decisions using Fuzzy MCDM , 2011 .

[203]  Henning Baars,et al.  Decision support for partially moving applications to the cloud: the example of business intelligence , 2013, HotTopiCS '13.

[204]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[205]  Lotfi A. Zadeh,et al.  The Concepts of a Linguistic Variable and its Application to Approximate Reasoning , 1975 .

[206]  Ping Cao,et al.  Ant Colony Optimization Algorithm for Vendor Selection in Information Systems Outsourcing , 2009, 2009 International Conference on Business Intelligence and Financial Engineering.

[207]  Gunnar Abrahamson,et al.  Terminology for model credibility , 1980 .

[208]  Flávio R. C. Sousa,et al.  A Petri net-based decision-making framework for assessing cloud services adoption: The use of spot instances for cost reduction , 2015, J. Netw. Comput. Appl..

[209]  Chyan Yang,et al.  A decision model for IS outsourcing , 2000, Int. J. Inf. Manag..

[210]  Ching-Lai Hwang,et al.  Fuzzy Multiple Attribute Decision Making - Methods and Applications , 1992, Lecture Notes in Economics and Mathematical Systems.

[211]  Saji K. Mathew.  Understanding Risk in IT Outsourcing: A Fuzzy Framework , 2006 .

[212]  Sohail Jabbar,et al.  A novel trust model for selection of Cloud Service Provider , 2014, 2014 World Symposium on Computer Applications & Research (WSCAR).

[213]  Prasad Saripalli,et al.  MADMAC: Multiple Attribute Decision Methodology for Adoption of Clouds , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[214]  Brian Corbitt,et al.  Towards an economic analysis of IT outsourcing risks , 2005 .

[215]  Hanna-Vera Müller,et al.  Multivendor Portfolio Strategies In Cloud Computing , 2013, ECIS.

[216]  G. Parnell.  Handbook of Decision Analysis , 2013 .

[217]  Cao Ping,et al.  A Multi-objective Model of Information System Outsourcing Decision for Suppliers Selection , 2009, 2009 International Conference on Computational Intelligence and Natural Computing.

[218]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[219]  Henry Mintzberg,et al.  Opening up Decision Making: The View from the Black Stool , 1995 .

[220]  Boonlert Watjatrakul,et al.  Vendor selection strategy for IT outsourcing: the weighted-criteria evaluation technique , 2014, J. Enterp. Inf. Manag..

[221]  Jingjing Xu,et al.  Developing a Decision Model for It Outsourcing Using Analytic Hierarchy Process , 2009, 2009 International Conference on Management and Service Science.

[222]  Lazar Rusu,et al.  User Acceptance of a Software Tool for Decision Making in IT Outsourcing: A Qualitative Study in Large Companies from Sweden , 2010, WSKS.

[223]  De-Li Yang,et al.  Developing a Decision Support Model for Information Systems Outsourcing , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[224]  K. K. F. Yuen,et al.  Software-as-a-Service evaluation in cloud paradigm: Primitive cognitive network process approach , 2012, 2012 IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC 2012).

[225]  James D. McKeen,et al.  Developments in Practice XIV: IT Sourcing - How Far Can You Go? , 2004, Commun. Assoc. Inf. Syst..

[226]  Qi Yu.  CloudRec: a framework for personalized service Recommendation in the Cloud , 2013, Knowledge and Information Systems.

[227]  T. L. Saaty.  A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[228]  Anette Brannemo,et al.  How does the industry work with sourcing decisions? Case study at two Swedish companies , 2006 .

[229]  Jennifer Blaskovich,et al.  Information Technology Outsourcing: A Taxonomy of Prior Studies and Directions for Future Research , 2011, J. Inf. Syst..

[230]  Robert T. Clemen,et al.  Making Hard Decisions with DecisionTools , 2013 .

[231]  Amy Z. Zeng,et al.  Applying the analytic hierarchy process to the offshore outsourcing location decision , 2008 .

[232]  Liisa von Hellens,et al.  A qualitative case study of the adoption and use of an agricultural decision support system in the Australian cotton industry: The socio-technical view , 2009, Decis. Support Syst..

[233]  Amrik S. Sohal,et al.  Taxonomy of outsourcing decision models , 2013 .

[234]  Vadlamani Ravi,et al.  Ranking cloud services using fuzzy multi-attribute decision making , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[235]  David L. Olson,et al.  A simulation study of IT outsourcing in the credit card business , 2006, Eur. J. Oper. Res..

[236]  Sherri MacKay,et al.  Closing the Research-Practice Gap: Factors Affecting Adoption and Implementation of a Children's Mental Health Program , 2006, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[237]  Chaochang Chiu,et al.  Predicting information systems outsourcing success using a hierarchical design of case-based reasoning , 2004, Expert Syst. Appl..

[238]  Chen-Tung Chen,et al.  A decision-making method based on interval-valued fuzzy sets for cloud service evaluation , 2010, 4th International Conference on New Trends in Information Science and Service Science.

[239]  Gilbert Fridgen,et al.  Using financial derivatives to hedge against market risks in IT outsourcing projects – a quantitative decision model , 2013, J. Decis. Syst..

[240]  Leslie P. Willcocks,et al.  The Relationship Advantage: Information Technologies, Sourcing, and Management , 2002 .