A methodology for controlled empirical investigation of membership continuity and change in GDSS groups

Controlled laboratory experiments using monetary rewards tied directly to performance are detailed and illustrated, as part of a methodology for investigating how membership continuity and change affect group meeting performance, solution time, and productivity. Performance-based rewards were structured to induce subject attendance and to prompt subjects to contribute their best effort. A key element of our methodology is the ability to successfully conduct longitudinal studies. We illustrate the methodology in an example study of groups of size three and groups of size five. Experiments are carefully monitored and controlled as a means to begin development of a set of consistent and comparable investigations, of groups of differing sizes and differing levels of membership continuity and change. The initial experiments yielded results formally verifying that membership continuity produces better meeting outcomes (increased performance and productivity, and decreased solution time) while membership change produced the exact opposite (decreased performance and productivity, and increased solution time). Drawing from philosophy of science, we emphasize the importance of carefully checking and verifying in a longitudinal study even what some might suggest as "obvious."

[1]  J. McGrath Time, Interaction, and Performance (TIP) , 1991 .

[2]  James R. Marsden,et al.  Asymmetric information A laboratory experimental analysis , 1997 .

[3]  Colin Camerer,et al.  Advances in behavioral economics , 2004 .

[4]  J. Marsden,et al.  An experimental approach to intelligent organizational design , 1992 .

[5]  V. Smith Papers in experimental economics , 1991 .

[6]  Arlington Williams,et al.  Computerized Double-Auction Markets: Some Initial Experimental Results , 1980 .

[7]  Holly Arrow,et al.  Membership Matters , 1993 .

[8]  Ramesh Sharda,et al.  Decision support system effectiveness: a review and an empirical test , 1988 .

[9]  R. Watson A study of group decision support system use in three and four-person groups for a preference alloca , 1987 .

[10]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[11]  James R. Marsden,et al.  Test of market efficiencies using experimental electronic markets , 1998 .

[12]  Robert P. Bostrom,et al.  A Longitudinal Study of the Impact of Group Decision Support Systems on Group Development , 1990, J. Manag. Inf. Syst..

[13]  François Bergeron,et al.  Factors Influencing the Use of DP Chargeback Information , 1986, MIS Q..

[14]  R. Ziller,et al.  Group creativity under conditions of success or failure and variations in group stability. , 1962 .

[15]  James R. Marsden,et al.  The design and use of laboratory experiments for DSS evaluation , 1993, Decis. Support Syst..

[16]  Guy Fitzgerald,et al.  Research methods in information systems , 1985 .

[17]  Valerie A. Ramey,et al.  The effects of market organization on conspiracies in restraint of trade , 1984 .

[18]  James R. Marsden,et al.  End user - IS design professional interaction - information exchange for firm profit or end user satisfaction? , 1988, Inf. Manag..

[19]  R. Ashton,et al.  Students As Surrogates In Behavioral Accounting Research - Some Evidence , 1980 .

[20]  Jay F. Nunamaker,et al.  A Comparison of Laboratory and Field Research in the Study of Electronic Meeting Systems , 1990, J. Manag. Inf. Syst..

[21]  Poppy Lauretta McLeod,et al.  An Assessment of the Experimental Literature on Electronic Support of Group Work: Results of a Meta-Analysis , 1992, Hum. Comput. Interact..

[22]  Ilze Zigurs,et al.  Adoption Patterns and Attitudinal Development in Computer-Supported Meetings: An Exploratory Study with SAMM , 1991, J. Manag. Inf. Syst..

[23]  Joseph B. Walther,et al.  A longitudinal experiment on relational tone in computer-mediated and face to face interaction , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[24]  James R. Marsden,et al.  An Empirical Investigation Into the Relation Between Performance and Perception of Users With a What-If Facility , 1997, J. Organ. Comput. Electron. Commer..

[25]  James R. Marsden,et al.  A multisession comparative study of group size and group performance in an electronic meeting system environment , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[26]  R. Bostrom,et al.  Evolution of group performance over time: A repeated measures study of GDSS effects , 1993 .

[27]  J. Kagel,et al.  The Winner's Curse and Public Information in Common Value Auctions: Comment , 1999 .

[28]  Joseph E. McGrath,et al.  Introduction: The JEMCO Workshop-Description of a Longitudinal Study , 1993 .

[29]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[30]  Deborah H. Gruenfeld,et al.  Groups, Tasks, and Technology , 1993 .

[31]  François Bergeron The success of DP charge-back systems from a user's perception , 1986, Inf. Manag..

[32]  J. McGrath,et al.  Group Task Performance and Communication Technology , 1993 .

[33]  Izak Benbasat,et al.  The Information Systems Research Challenge: Experimental Research Methods , 1990 .