The use of meta-analysis in MIS research: promises and problems

Meta-ana/ysis involves the use of statistical procedures to integrate research findings across studies. Although it has been warmly embraced in those fields in which experiments are widely used, its application by M/S researchers is very limited. This research explores issues that are important to the conduct and evaluation of metaanalysis. The paper shows that meta-ana/ysis has important advantages over traditional reviews. The potential application of meta-ana/ysis in research integration and theory development and testing is discussed. The use of metaanalysis in M/S research in the past is reviewed. Opportunities for increased use of meta-ana/ysis in the future are investigated. Limitations and potential problems of meta-ana/ysis are discussed to facilitate the evaluation of metaanalysis results. I/tilth these issues clarified, this research should increase the interest of MIS researchers in meta-analysis and its applications.

[1]  Maryam Alavi,et al.  Revisiting DSS Implementation Research: A Meta-Analysis of the Literature and Suggestions for Researchers , 1992, MIS Q..

[2]  Iris Vessey,et al.  Cognitive Fit: A Theory‐Based Analysis of the Graphs Versus Tables Literature* , 1991 .

[3]  James Price Dillard,et al.  The Uses of Meta-Analysis: Making Knowledge Claims and Setting Research Agendas. , 1991 .

[4]  Iris Vessey,et al.  The Effect of User Involvement on System Success: A Contingency Approach , 1988, MIS Q..

[5]  G. Glass.  Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[6]  I H HwangMark,et al.  The effectiveness of computer graphics for decision support , 1991 .

[7]  Jay F. Nunamaker,et al.  A Comparison of Laboratory and Field Research in the Study of Electronic Meeting Systems , 1990, J. Manag. Inf. Syst..

[8]  Poppy Lauretta McLeod,et al.  An Assessment of the Experimental Literature on Electronic Support of Group Work: Results of a Meta-Analysis , 1992, Hum. Comput. Interact..

[9]  Ilze Zigurs,et al.  Adoption Patterns and Attitudinal Development in Computer-Supported Meetings: An Exploratory Study with SAMM , 1991, J. Manag. Inf. Syst..

[10]  R. Rosenthal.  Meta-analytic procedures for social research , 1984 .

[11]  Richard F. Beltramini,et al.  Meta-Analysis: Quantitative Methods for Research Synthesis , 1987 .

[12]  Steven P. Brown,et al.  ANTECEDENTS AND CONSEQUENCES OF SALESPERSON JOB SATISFACTION: META ANALYSIS AND ASSESSMENT OF CAUSAL EFFECTS , 1993 .

[13]  M. L. Smith,et al.  Meta-analysis of psychotherapy outcome studies. , 1977, The American psychologist.

[14]  Thomas D. Cook,et al.  Meta-analysis: Its potential for causal description and causal explanation within program evaluation , 1991 .

[15]  Irving M. Lane,et al.  A Review of Meta-Analyses in Organizational Behavior and Human Resources Management: An Empirical Assessment , 1991 .

[16]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[17]  Izak Benbasat,et al.  Process Tracing Methods in Decision Support Systems Research: Exploring the Black Box , 1987, MIS Q..

[18]  Roger A. Stone.  “Clinical and cost-saving effects of psychoeducational interventions with surgical patients: A meta-analysis,” , 1988 .

[19]  John E. Hunter,et al.  Methods of Meta-Analysis: Correcting Error and Bias in Research Findings , 1991 .

[20]  E C Devine,et al.  Clinical and cost-saving effects of psychoeducational interventions with surgical patients: a meta-analysis. , 1986, Research in nursing & health.

[21]  Bruce J. P. Wu,et al.  The effectiveness of computer graphics for decision support: meta-analytical integration of research findings , 1991, DATB.

[22]  Wynne W. Chin,et al.  Applying Adaptive Structuration Theory to Investigate the Process of Group Support Systems Use , 1992, J. Manag. Inf. Syst..

[23]  Hannah R. Rothstein,et al.  Meta-Analysis and Construct Validity , 1992 .

[24]  William Remus,et al.  A Study of Graphical and Tabular Displays and Their Interaction with Environmental Complexity , 1987 .

[25]  N. Venkatraman.  The Concept of Fit in Strategy Research: Towards Verbal and Statistical Congruence. , 1987 .

[26]  Stephen W. Raudenbush,et al.  Magnitude of teacher expectancy effects on pupil IQ as a function of the credibility of expectancy induction: A synthesis of findings from 18 experiments. , 1984 .

[27]  Izak Benbasat,et al.  An Investigation of the Effectiveness of Color and Graphical Information Presentation Under Varying Time Constraints , 1986, MIS Q..

[28]  Wanda J. Orlikowski,et al.  The Problem of Statistical Power in MIS Research , 1989, MIS Q..

[29]  Larry V. Hedges,et al.  A Practical Guide to Modern Methods of Meta-Analysis. , 1989 .

[30]  W. Shadish,et al.  Mediators and moderators in meta-analysis: there's a reason we don't let dodo birds tell us which psychotherapies should have prizes. , 1991, Journal of consulting and clinical psychology.

[31]  Peter M. Bentler,et al.  EQS : structural equations program manual , 1989 .

[32]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[33]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[34]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[35]  Craig K. Tyran,et al.  An Evaluation of Electronic Meeting Systems to Support Strategic Management , 1990, ICIS.

[36]  I. Benbasat,et al.  The Effects of Group, Task,Context, and Technology Variables on the Usefulness of Group Support Systems , 1993 .

[37]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[38]  S. Premack,et al.  Individual unionization decisions. , 1988 .

[39]  Robert W. Zmud,et al.  The Impact of Color Graphic Report Formats on Decision Performance and Learning , 1983, ICIS.

[40]  Gerardine DeSanctis,et al.  Computer-Based Support for Group Problem-Finding: An Experimental Investigation , 1988, MIS Q..

[41]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[42]  Gerardine DeSanctis,et al.  Understanding the use of Group Decision Support Systems: The Theory of Adaptive Structuration , 1990 .

[43]  S. Wang,et al.  The Effects of Modes of Information Presentation on Decision-Making: A Review and Meta-Analysis , 1989, J. Manag. Inf. Syst..

[44]  Richard T. Watson,et al.  Group decision support systems: the cultural factor , 1989, ICIS '89.

[45]  K. S. Raman,et al.  The Effect of GDSS and Elected Leadership on Small Group Meetings , 1991, J. Manag. Inf. Syst..

[46]  Thomas Marshall,et al.  A Review of the Influence of User Involvement on System Success , 1988, ICIS.

[47]  Gregg B. Jackson,et al.  Meta-Analysis: Cumulating Research Findings Across Studies , 1982 .