Towards an Instrument to Measure Successfulness of Collaborative Effort from a Participant Perspective

In this paper we present an instrument to measure success of collaboration. The instrument offers metrics to measure success of collaboration along six dimensions; efficiency, effectiveness, productivity, satisfaction with the process, satisfaction with results and commitment. The satisfaction metrics were used from [1]. The instrument was tested to verify its validity. We found useful instruments for two new constructs; commitment and efficiency. The instrument can be used by practitioners, collaboration engineers and facilitators to assess and compare the successfulness of the interventions they make to support groups in achieving their goal. Further research is required to refine the metrics for productivity, efficiency and effectiveness.

[1]  E. A. Locke,et al.  A theory of goal setting & task performance , 1990 .

[2]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[3]  G. Grossman,et al.  Innovation and growth in the global economy , 1993 .

[4]  Alan R. Dennis,et al.  Investigating the Moderators of the Group Support Systems Use with Meta-Analysis , 2002, J. Manag. Inf. Syst..

[5]  Starr Roxanne Hiltz,et al.  Group Support Systems: A Descriptive Evaluation of Case and Field Studies , 2000, J. Manag. Inf. Syst..

[6]  Alan R. Dennis,et al.  Understanding Fit and Appropriation Effects in Group Support Systems via Meta-Analysis , 2001, MIS Q..

[7]  Fred Niederman,et al.  Towards an Instrument to Measure Participants' Perceptions on Facilitation in Group Support Systems Meetings , 2002 .

[8]  Robert O. Briggs,et al.  Bounded Ideation Theory: A New Model of the Relationship Between Ideaquantity and Idea-quality during Ideation , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[9]  Victoria K. Clawson,et al.  The Role of the Facilitator in Computer-Supported Meetings , 1993 .

[10]  R. Briggs,et al.  Meeting Satisfaction for Technology-Supported Groups , 2006 .

[11]  John P. Meyer,et al.  Commitment in the workplace: toward a general model , 2001 .

[12]  Robert Davison,et al.  An instrument for measuring meeting success: revalidation and modification , 1999, Inf. Manag..

[13]  E.A.J.A. Rouwette,et al.  Choice criteria for facilitation techniques , 2006 .

[14]  Robert O. Briggs,et al.  The Yield Shift Theory of Satisfaction and Its Application to the IS/IT Domain , 2008, J. Assoc. Inf. Syst..

[15]  P. Drucker,et al.  The age discontinuity. , 1979, Population bulletin.

[16]  B. Baltes,et al.  Computer-Mediated Communication and Group Decision Making: A Meta-Analysis , 2002 .

[17]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[18]  Robert O. Briggs,et al.  Defining Key Concepts for Collaboration Engineering , 2006, AMCIS.

[19]  M. Hwang.  Did Task Type Matter in the Use of Decision Room GSS? A Critical Review and a Meta-analysis , 1998 .

[20]  S. Qureshi,et al.  Activating knowledge through electronic collaboration: vanquishing the knowledge paradox , 2004, IEEE Transactions on Professional Communication.

[21]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[22]  Starr Roxanne Hiltz,et al.  An Assessment of Group Support Systems Experimental Research: Methodology and Results , 1998, J. Manag. Inf. Syst..

[23]  Bruce A. Reinig,et al.  Toward an Understanding of Satisfaction with the Process and Outcomes of Teamwork , 2003, J. Manag. Inf. Syst..

[24]  Joseph P. Martino,et al.  The Delphi method: Techniques and applications: Linstone, Harold A., and Murray Turoff, Addison-Wesley. Advanced Book Program, Reading, MA, 1975, xx, 620 pp, $29.50 (hardbound), $16.50 (paperbound). , 1976 .

[25]  Poppy Lauretta McLeod,et al.  An Assessment of the Experimental Literature on Electronic Support of Group Work: Results of a Meta-Analysis , 1992, Hum. Comput. Interact..

[26]  Gary Klein,et al.  Supervisor Support and Career Anchor Impact on the Career Satisfaction of the Entry-Level Information Systems Professional , 1999, J. Manag. Inf. Syst..

[27]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[28]  Mariëlle den Hengst,et al.  Assessing the Quality of Collaborative Processes , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[29]  Matthew K. O. Lee,et al.  A proposed model and measurement instrument for the formation of IS satisfaction: the case of end-user computing satisfaction , 2000, ICIS.

[30]  Barbara M. Byrne,et al.  Structural equation modeling with AMOS , 2010 .

[31]  Eileen M. Trauth,et al.  Understanding Computer-Mediated Discussions: Positivist and Interpretive Analyses of Group Support System Use , 2000, MIS Q..

[32]  Craig K. Tyran,et al.  GSS and learning research: a review and assessment of the early studies , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[33]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[34]  A. Frost.  Meetings Around the World : The Impact of Collaboration on Business Performance , 2006 .

[35]  I. Nonaka.  A Dynamic Theory of Organizational Knowledge Creation , 1994 .