The effect of user engagement on system success: A meta-analytical integration of research findings

The effect of user involvement on system success is an important topic yet empirical results have been controversial. Many methodological and theoretical differences among prior studies have been suggested as possible causes for inconsistent findings. This research is an attempt to resolve inconsistent data despite differences that may exist in prior studies. Data from 25 studies were meta-analyzed to test the separate effects of user participation and user involvement on six system success variables. Results showed that user participation had a moderate positive correlation with four success measures: system quality, use, user satisfaction, and organizational impact. The correlation between user participation and individual impact was minimum. User involvement generally had a larger correlation with system success than did user participation. Overall, these findings indicate that both user involvement and user participation are beneficial, but the magnitude of these benefits much depends on how involvement and its effect are defined.

[1]  Blake Ives,et al.  User Involvement and MIS Success: A Review of Research , 1984 .

[2]  Blake Ives,et al.  An empirical study of the impact of user involvement on system usage and information satisfaction , 1986, CACM.

[3]  S. Wang,et al.  The Effects of Modes of Information Presentation on Decision-Making: A Review and Meta-Analysis , 1989, J. Manag. Inf. Syst..

[4]  Jinjoo Lee,et al.  An exploratory contingency model of user participation and MIS use , 1986, Inf. Manag..

[5]  Blake Ives,et al.  Executive Involvement and Participation in the Management of Information Technology , 1991, MIS Q..

[6]  Leon A. Kappelman,et al.  The Respective Roles Of User Participation And User Involvement In Information System Implementation Success , 1991, ICIS.

[7]  Anders Edstrom,et al.  User Influence and the Success of MIS Projects: A Contingency Approach , 1977 .

[8]  Gholamreza Torkzadeh,et al.  A path analytic study of determinants of information system usage , 1994 .

[9]  Iris Vessey,et al.  The Effect of User Involvement on System Success: A Contingency Approach , 1988, MIS Q..

[10]  Daniel Robey,et al.  User Involvement in Information System Development: A Conflict Model and Empirical Test , 1982 .

[11]  Charles Russel Franz,et al.  Contingency factors affecting the user involvement role in the design of successful information systems. , 1979 .

[12]  Henri Barki,et al.  Explaining the Role of User Participation in Information System Use , 1994 .

[13]  Tor Guimaraes,et al.  Exploring the Factors Associated with Expert Systems Success , 1995, MIS Q..

[14]  G. R. Reeves.  Inventory decisions in product-mix models , 1976 .

[15]  Maryam Alavi,et al.  Revisiting DSS Implementation Research: A Meta-Analysis of the Literature and Suggestions for Researchers , 1992, MIS Q..

[16]  Angèle L. M. Cavaye,et al.  User participation in system development revisited , 1995, Inf. Manag..

[17]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[18]  Tor Guimaraes,et al.  Empirically testing the outcomes of user involvement in DSS development , 1994 .

[19]  W. Doll,et al.  A discrepancy model of end-user computing involvement , 1989 .

[20]  Mm Etschmaier,et al.  Operations research in the management of the airlines , 1974 .

[21]  Varun Grover,et al.  Forecasting the Next 50 Years in Information Technology , 1996, DATB.

[22]  Tsang-Hsiung Lee,et al.  The Effects Of User Participation On System Success: Toward A Contingency Theory Of User Satisfaction , 1991, ICIS.

[23]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[24]  Ephraim R. McLean,et al.  Information Systems Success: The Quest for the Independent Variables , 1992, J. Manag. Inf. Syst..

[25]  E. B. Swanson,et al.  Management Information Systems: Appreciation and Involvement , 1974 .

[26]  William J. Doll,et al.  The Measurement of End-User Computing Satisfaction , 1988, MIS Q..

[27]  William R. King,et al.  Note-Participative Design of Strategic Decision Support Systems: An Empirical Assessment , 1981 .

[28]  I. Benbasat,et al.  The Effects of Group, Task,Context, and Technology Variables on the Usefulness of Group Support Systems , 1993 .

[29]  Tor Guimaraes,et al.  The Relationship Between User Participation and User Satisfaction: An Investigation of Four Contingency Factors , 1994, MIS Q..

[30]  Mark I. H. Hwang,et al.  The use of meta-analysis in MIS research: promises and problems , 1996, DATB.

[31]  Graham C. Low,et al.  Exploring Individual User Satisfaction Within User-Led Development , 1993, MIS Q..

[32]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .

[33]  Morgan Swink,et al.  The Influences of User Characteristics on Performance in a Logistics DSS Application , 1995 .

[34]  Henri Barki,et al.  Rethinking the Concept of User Involvement , 1989, MIS Q..

[35]  A. Wandersman.  User Participation , 1979 .

[36]  Edward J. Garrity,et al.  User Participation, Management Support and System Types , 1994 .

[37]  Dorothy Leonard-Barton,et al.  Developer-User Interaction and User Satisfaction in Internal Technology Transfer , 1993 .

[38]  Alexander M. Maish.  A User's Behavior Toward His MIS , 1979, MIS Q..

[39]  Tor Guimaraes,et al.  Factors important to expert systems success a field test , 1996, Inf. Manag..

[40]  Y. Braunstein,et al.  Information management , 1996 .

[41]  Thomas E. Drabek,et al.  The Organizational Context , 1990 .

[42]  Poppy Lauretta McLeod,et al.  An Assessment of the Experimental Literature on Electronic Support of Group Work: Results of a Meta-Analysis , 1992, Hum. Comput. Interact..

[43]  Thomas D. Cook,et al.  Meta-analysis: Its potential for causal description and causal explanation within program evaluation , 1991 .

[44]  Blake Ives,et al.  User Involvement in System Design: An Empirical Test of Alternative Approaches , 1981, Inf. Manag..

[45]  C. R. Franz,et al.  ORGANIZATIONAL CONTEXT, USER INVOLVEMENT, AND THE USEFULNESS OF INFORMATION SYSTEMS* , 1986 .

[46]  Marcus O'Connor,et al.  MIS success: why does it vary among users? , 1992, J. Inf. Technol..

[47]  A. V. Sioukas,et al.  User involvement for effective customization: an empirical study on voice networks , 1995 .

[48]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.