Broadening Information Systems Evalutation Through Narratives

The purpose of information systems post-evaluation ought to be to improve the use of systems. The paper proposes the use of narratives as a tool in post-evaluations. The potential in narratives is that they can convey meanings, interpretations, and knowledge about the system, which may potentially lead to action. The paper offer three main suggestions: 1) evaluations should form the basis for action; 2) narratives makes evaluation more relevant; and 3) post-evaluations should be done with the aim of improving use. Narratives should be viewed as a complement to traditional evaluation methods and as a way of making evaluation more formative and thereby moving away from the more common summative perception of evaluation. The conclusion of the paper is that narratives can advance IS evaluation and provide a richer evaluation picture by conveying meanings not included in traditional evaluations.

[1]  Richard L. Daft,et al.  Organizational information requirements, media richness and structural design , 1986 .

[2]  R. Hirschheim,et al.  Evaluation of information systems: a critical assessment , 1998 .

[3]  P. Strassmann.  Information Payoff: The Transformation of Work in the Electronic Age , 1985 .

[4]  Leslie P. Willcocks,et al.  Measuring organizational IS effectiveness: an overview and update of senior management perspectives , 2002, DATB.

[5]  Geoff Walsham,et al.  The Emergence of Interpretivism in IS Research , 1995, Inf. Syst. Res..

[6]  Steve Smithson,et al.  Information systems evaluation as an organizational institution – experience from a case study , 2003, Inf. Syst. J..

[7]  Hasse Clausen.  Designing Computer Systems from a Human Perspective: The Use of Narratives , 1994, Scand. J. Inf. Syst..

[8]  V. J. Symons,et al.  A review of information systems evaluation: content, context and process , 1991 .

[9]  Rudy Hirschheim,et al.  Symbolism and Information Systems Development: Myth, Metaphor and Magic , 1991, Inf. Syst. Res..

[10]  Sue Llewellyn,et al.  Narratives in accounting and management research , 1999 .

[11]  Steve Smithson,et al.  Information systems evaluation in practice: a case study of organizational change , 2000, J. Inf. Technol..

[12]  Steven Jones,et al.  Understanding IS evaluation as a complex social process: a case study of a UK local authority , 2001, Eur. J. Inf. Syst..

[13]  John W. Meyer,et al.  Institutionalized Organizations: Formal Structure as Myth and Ceremony , 1977, American Journal of Sociology.

[14]  M. Porter.  Competitive Advantage: Creating and Sustaining Superior Performance , 1985 .

[15]  Michael Sherwood-Smith,et al.  Maximise information systems value by continuous participative evaluation , 1999 .

[16]  David Snowden,et al.  The First Age: Information for Decision Support 1995: the Transition to the Second Age Complex Acts of Knowing: Paradox and Descriptive Self-awareness , 2022 .

[17]  Andrew D. Brown.  Narrative, Politics and Legitimacy in an IT Implimentation , 1998 .

[18]  Kuldeep Kumar,et al.  Post implementation evaluation of computer-based information systems: current practices , 1990, Commun. ACM.

[19]  Donald A. Schön,et al.  Theory in Practice: Increasing Professional Effectiveness , 1974 .

[20]  David Sinclair,et al.  Performance measurement as an obstacle to TQM , 1995 .

[21]  D. Sandy Staples,et al.  Dimensions of Information Systems Success , 1999, Commun. Assoc. Inf. Syst..

[22]  Richard L. Daft,et al.  Message Equivocality, Media Selection, and Manager Performance: Implications for Information Systems , 1987, MIS Q..

[23]  S. Giles.  Theory in practice. , 1993, Nursing times.

[24]  Zahir Irani,et al.  Information systems evaluation: past, present and future , 2001, Eur. J. Inf. Syst..

[25]  Rosı́o Alvarez.  The Myth of Integration: A Case Study of an ERP Implementation , 2002 .

[26]  E. Erickson.  Increasing Leadership Effectiveness , 1978 .

[27]  Geoff Walsham,et al.  Interpreting Information Systems in Organizations , 1993 .

[28]  Lisa Abrams,et al.  Using Mentoring and Storytelling to Transfer Knowledge in the Workplace , 2001, J. Manag. Inf. Syst..

[29]  David Targett,et al.  A taxonomy of information systems applications: the benefits' evaluation ladder , 1995 .

[30]  Michael D. Myers,et al.  A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems , 1999, MIS Q..

[31]  Matthias Jarke,et al.  Scenario Management: An Interdisciplinary Approach , 1998, Requirements Engineering.

[32]  D. Robey,et al.  Software stories: three cultural perspectives on the organizational practices of software development , 1999 .

[33]  Kenneth E. Murphy,et al.  Intangible benefits valuation in ERP projects , 2002, Inf. Syst. J..

[34]  Susanne Bødker.  Scenarios in user-centred designsetting the stage for reflection and action , 2000, Interact. Comput..

[35]  K. Weick.  Drop Your Tools: An Allegory for Organizational Studies. , 1996 .

[36]  M. Lynne Markus,et al.  Power, politics, and MIS implementation , 1987, CACM.

[37]  L. Hoebeke.  Measuring in organisations , 1990 .

[38]  Rosío Alvarez,et al.  Tell me a good story: using narrative analysis to examine information requirements interviews during an ERP implementation , 2002, DATB.

[39]  Annie I. Antón,et al.  A Representational Framework for Scenarios of System Use , 1998, Requirements Engineering.