Advancing the state of the art in the modelling and simulation of information systems evaluation

It is widely accepted that Information Systems Evaluation (ISE) is a powerful and useful technique that can be used to assess IT/IS investments in an a-priori or a-posteriori sense. Traditional approaches to ISE have tended to centre upon financial and management accounting frameworks, seeking to reconcile tangible and intangible costs, benefits, risks and value factors. Such techniques, however, do not provide the IS researcher or practitioner with further insight or appreciation of any inherent and implicit inter-relationships, in the investment justification process. Thus, this paper outlines and discusses via a taxonomy and resulting classification, alternative and complementary approaches that can be applied to ISE from the fields of Artificial Intelligence (AI), Operational Research (OR) and Management Science (MS). The paper subsequently concludes that such approaches can be potentially used by researchers and practitioners in the field, as a basis for carrying out further research in the field of applied ISE.

[1]  N. Metropolis,et al.  The Monte Carlo method. , 1949 .

[2]  Delvin Grant,et al.  Using Fuzzy Cognitive Maps to Assess MIS Organizational Change Impact , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[3]  Amir M. Sharif,et al.  Dealing with propositional ambiguity in business process improvement , 2004 .

[4]  John D. Sterman,et al.  Business dynamics : systems thinking and modelling for acomplex world , 2002 .

[5]  Charles E. Taylor Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Complex Adaptive Systems.John H. Holland , 1994 .

[6]  Cengiz Kahraman,et al.  Applying concepts of fuzzy cognitive mapping to model IT/IS investment evaluation factors , 2002 .

[7]  Alex Chong,et al.  Fuzzy Cognitive Maps and Intelligent Decision Support – a Review , 1999 .

[8]  Masao Kakihara,et al.  Knowledge discourses and interaction technology , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[9]  Daniel Svavarsson Evaluation of Strategic IT Platform Investments , 2004, AMCIS.

[10]  Kevin Zhu,et al.  Strategic Decisions of New Technology Adoption Under Asymmetric Information: A Game Theoretic Model , 2003, Decis. Sci..

[11]  Tom Ritchey Scenario Development and Risk Management Using Morphological Field Analysis: Research in Progress , 1997, ECIS.

[12]  Zahir Irani,et al.  The Propagation of Technology Management Taxonomies for Evaluating Investments in Information Systems , 2000, J. Manag. Inf. Syst..

[13]  Zahir Irani,et al.  Linking knowledge transformation to Information Systems evaluation , 2005, Eur. J. Inf. Syst..

[14]  Zahir Irani,et al.  Integrating ERP using EAI: a model for post hoc evaluation , 2005, Eur. J. Inf. Syst..

[15]  Zahir Irani,et al.  Research note: theoretical optimisation of IT/IS investments , 1999 .

[16]  F. Zwicky Discovery, Invention, Research through the morphological approach , 1969 .

[17]  S. Morgenthaler Robustness in Statistics , 2001 .

[18]  Zahir Irani,et al.  Investment justification of information technology in manufacturing , 1999 .

[19]  M. H. Small,et al.  Investment justification of advanced manufacturing technology: An empirical analysis , 1995 .

[20]  P. Senge,et al.  The Fifth Discipline Fieldbook , 1994 .

[21]  Alex Chong,et al.  Fuzzy Cognitive Maps With Genetic Algorithm For Goal-Oriented Decision Support , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[22]  G. Box Robustness in the Strategy of Scientific Model Building. , 1979 .

[23]  Jose Aguilar,et al.  A Survey about Fuzzy Cognitive Maps Papers (Invited Paper) , 2005 .

[24]  J. Nash,et al.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[25]  Peter L. Primrose,et al.  Investment in Manufacturing Technology , 1992 .

[26]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[27]  R. V. Oakford,et al.  An application of simulation for studying the multi-national capital budgeting problem , 1978, WSC '78.

[28]  James J. Browne,et al.  Financial simulation model: Assessing project risk at the Port Authority of New York and New Jersey , 1978, WSC '78.

[29]  Anthony Wensley,et al.  Game theory as a tool for understanding information services outsourcing , 1997, J. Inf. Technol..

[30]  Zahir Irani,et al.  Transforming failure into success through organisational learning: an analysis of a manufacturing information system , 2001, Eur. J. Inf. Syst..

[31]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[32]  Euiho Suh,et al.  A decision support system for investment planning on a microcomputer , 1992 .

[33]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[34]  Zahir Irani,et al.  Extending the Enterprise: An Evaluation of ERP and EAI Technologies within a Case Study Organisation , 2006, CONFENIS.

[35]  B. Hochstrasser Justifying IT investments , 1994 .

[36]  J. Forrester Industrial Dynamics , 1997 .

[37]  David N. Ford,et al.  Expert knowledge elicitation to improve mental and formal models , 1997 .

[38]  Bart Kosko,et al.  Neural networks and fuzzy systems , 1998 .

[39]  David W. Conrath,et al.  The Use of Cognitive Mapping for Information Requirements Analysis , 1986, MIS Q..

[40]  Ronald L. Wasserstein,et al.  Monte Carlo: Concepts, Algorithms, and Applications , 1997 .

[41]  Peter E.D. Love,et al.  Applying concepts of fuzzy cognitive mapping to model: The IT/IS investment evaluation process , 2002 .

[42]  Steffen Bayer,et al.  Business dynamics: Systems thinking and modeling for a complex world , 2004 .

[43]  H. Bierman,et al.  Game theory with economic applications , 1993 .

[44]  Tom Renkema Boekbespreking Farbey, B.; Land, F.; Targett, D.: how to assess your IT investment, a study of methods and practice (Butterworth Heinemann, Oxford, 1993) , 1994 .

[45]  Russell Rhyne,et al.  Field anomaly relaxation , 1995 .

[46]  Rg Coyle,et al.  Futures assessment by field anomaly relaxation: A review and appraisal , 1994 .

[47]  John D. Sterman,et al.  All models are wrong: reflections on becoming a systems scientist† , 2002 .

[48]  Zahir Irani,et al.  Exploring Fuzzy Cognitive Mapping for IS Evaluation , 2006, Eur. J. Oper. Res..

[49]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[50]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .