A Consensus-Based Multicriteria Group Decision Model for Information Technology Management Committees

Reaching consensus on decisions—especially when they involve multiple criteria, uncertainty and risk—is a major challenge that Information Technology (IT) Management Committees routinely face. Multicriteria decision-making models could offer support, but may be cumbersome to use when uncertainty and risk are also to be factored in, as it is common in IT service management contexts, for more comprehensive and realistic decisions. Difficulties arise when committee members, who need not be familiar with estimating uncertainty and describing their own or the organization's risk appetite, have to input such estimates to a decision support model. This paper presents a consensus-seeking, IT decision support model that internally blends interval algebra, utility theory and an extended analytic hierarchy process method to account for uncertainty, risk and multiple criteria, respectively. Consensus seeking is supported by the Delphi technique. The model was implemented in two software tools, designed to require little knowledge by users about the model's internals. Three case studies were undertaken in real companies to validate the model. Face validity results offer evidence the model/tools are useful to IT committee members by dispensing with direct, explicit users’ provision of information on uncertainty and risk and by facilitating their consensual decision making.

[1]  She-I Chang,et al.  An analysis of IT/IS outsourcing provider selection for small- and medium-sized enterprises in Taiwan , 2012, Inf. Manag..

[2]  Xiaowei Xu,et al.  Multi-criteria decision making approaches for supplier evaluation and selection: A literature review , 2010, Eur. J. Oper. Res..

[3]  Paul L. Bowen,et al.  Enhancing IT governance practices: A model and case study of an organization's efforts , 2007, Int. J. Account. Inf. Syst..

[4]  Detmar W. Straub,et al.  How Information Technology Governance Mechanisms and Strategic Alignment Influence Organizational Performance: Insights from a Matched Survey of Business and IT Managers , 2015, MIS Q..

[5]  Yuan Li,et al.  A model for selecting an ERP system based on linguistic information processing , 2007, Inf. Syst..

[6]  James Surowiecki The wisdom of crowds: Why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations Doubleday Books. , 2004 .

[7]  S. Pliska,et al.  Risk-Sensitive Dynamic Asset Management , 1999 .

[8]  Markus Buschle,et al.  Experimental Evidence on Decision-Making in Availability Service Level Agreements , 2016, IEEE Transactions on Network and Service Management.

[9]  T. Saaty,et al.  Negative priorities in the analytic hierarchy process , 2003 .

[10]  Edmund A. Mennis The Wisdom of Crowds: Why the Many Are Smarter than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations , 2006 .

[11]  Acklesh Prasad,et al.  A capabilities-based approach to obtaining a deeper understanding of information technology governance effectiveness: Evidence from IT steering committees , 2010, Int. J. Account. Inf. Syst..

[12]  Edmundas Kazimieras Zavadskas,et al.  Fuzzy multiple criteria decision-making techniques and applications - Two decades review from 1994 to 2014 , 2015, Expert Syst. Appl..

[13]  W. Pedrycz,et al.  A fuzzy extension of Saaty's priority theory , 1983 .

[14]  Nick Antonopoulos,et al.  Cloud BI: Future of business intelligence in the Cloud , 2015, J. Comput. Syst. Sci..

[15]  William C. Wedley,et al.  Modelling risk and uncertainty with the analytic hierarchy process , 2002 .

[16]  Shih-Chi Chang,et al.  Using a fuzzy multi-criteria decision making approach to evaluate alternative licensing mechanisms , 2005, Inf. Manag..

[17]  Thomas L. Saaty,et al.  The analytic hierarchy process : planning, priority setting, resource allocation , 1980 .

[18]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[19]  A. Kiureghian,et al.  Aleatory or epistemic? Does it matter? , 2009 .

[20]  Ernest H. Forman,et al.  Group decision support with the Analytic Hierarchy Process , 1992, Decis. Support Syst..

[21]  Jaemyung Ahn,et al.  Design Structure Matrix Modeling of a Supply Chain Management System Using Biperspective Group Decision , 2017, IEEE Transactions on Engineering Management.

[22]  Eric W. T. Ngai,et al.  Selection of web sites for online advertising using the AHP , 2003, Inf. Manag..

[23]  Kalle Lyytinen,et al.  Does Steering Committee Information Processing Capacity Influence Project Success in Enterprise-Wide System Implementations , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[24]  P. Weill,et al.  IT Governance , 2017 .

[25]  Per Runeson,et al.  Guidelines for conducting and reporting case study research in software engineering , 2009, Empirical Software Engineering.

[26]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[27]  Thomas L. Saaty,et al.  Time dependent decision-making; dynamic priorities in the AHP/ANP: Generalizing from points to functions and from real to complex variables , 2007, Math. Comput. Model..

[28]  Hao Li Decision-making in Committees , 2009 .

[29]  Bo K. Wong,et al.  Group decision making in a multiple criteria environment: A case using the AHP in software selection , 2002, Eur. J. Oper. Res..

[30]  Xiaogang Wang,et al.  Learning Scene-Independent Group Descriptors for Crowd Understanding , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Flávio R. C. Sousa,et al.  Improving group decision-making in IT service management by the use of a consensus-based MCDM method , 2015, 2015 Latin American Network Operations and Management Symposium (LANOMS).

[32]  Evangelos Triantaphyllou,et al.  Multi-criteria Decision Making Methods: A Comparative Study , 2000 .

[33]  Zeshui Xu,et al.  An automatic ranking approach for multi-criteria group decision making under intuitionistic fuzzy environment , 2015, Fuzzy Optim. Decis. Mak..

[34]  Cesare Stefanelli,et al.  On decision making in business-driven IT management , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[35]  Cengiz Kahraman,et al.  Project risk evaluation using a fuzzy analytic hierarchy process: An application to information technology projects , 2006, Int. J. Intell. Syst..

[36]  Hermann G. Matthies,et al.  QUANTIFYING UNCERTAINTY: MODERN COMPUTATIONAL REPRESENTATION OF PROBABILITY AND APPLICATIONS , 2007 .

[37]  George P. Huber,et al.  Issues in the Design of Group Decision Support Systems , 1984, MIS Q..

[38]  Deng-Feng Li,et al.  Multiattribute decision making models and methods using intuitionistic fuzzy sets , 2005, J. Comput. Syst. Sci..

[39]  Chen-Fu Chien,et al.  An AHP-based approach to ERP system selection , 2005 .

[40]  Wen-Chin Chen,et al.  A fuzzy AHP and BSC approach for evaluating performance of IT department in the manufacturing industry in Taiwan , 2008, Expert Syst. Appl..

[41]  Ali al-Nowaihi,et al.  A Note on the Utility Function Under Prospect Theory , 2007 .

[42]  George Wright,et al.  The Delphi technique as a forecasting tool: issues and analysis , 1999 .

[43]  Luis G. Vargas,et al.  How to Make A Decision , 2012 .

[44]  Hui Zhang,et al.  Evaluation on Information Technology Service Management Process with AHP , 2011 .

[45]  Gloria E. Phillips-Wren,et al.  Aided search strategy enabled by decision support , 2006, Inf. Process. Manag..

[46]  José M. Merigó,et al.  New decision-making techniques and their application in the selection of financial products , 2010, Inf. Sci..

[47]  Arkadi Nemirovski,et al.  Robust optimization – methodology and applications , 2002, Math. Program..

[48]  Flávio R. C. Sousa,et al.  A Petri net-based decision-making framework for assessing cloud services adoption: The use of spot instances for cost reduction , 2015, J. Netw. Comput. Appl..

[49]  Chyan Yang,et al.  A decision model for IS outsourcing , 2000, Int. J. Inf. Manag..

[50]  Joseph G. Eisenhauer,et al.  Survey measures of risk aversion and prudence , 2003 .

[51]  Robert W. Zmud,et al.  Influencing the effectiveness of IT governance practices through steering committees and communication policies , 2010, Eur. J. Inf. Syst..

[52]  Terry Speed Statistics for Experimenters: Design, Innovation, and Discovery (2nd ed.) , 2006 .

[53]  Philip Yetton,et al.  Allocation of IT Decision Rights in Multibusiness Organizations: What Decisions, Who Makes Them, and when are They Taken? , 2010, ICIS.

[54]  Marc Streit,et al.  WeightLifter: Visual Weight Space Exploration for Multi-Criteria Decision Making , 2017, IEEE Transactions on Visualization and Computer Graphics.