Towards an instrument to measure Successfulness of collaborative effort from a participant perspective

In this paper we present an instrument to measure success of collaboration. The instrument offers metrics to measure success of collaboration along six dimensions; efficiency, effectiveness, productivity, satisfaction with the process, satisfaction with results and commitment. The satisfaction metrics were used from [1]. The instrument was tested to verify its validity. We found useful instruments for two new constructs; commitment and efficiency. The instrument can be used by practitioners, collaboration engineers and facilitators to assess and compare the successfulness of the interventions they make to support groups in achieving their goal. Further research is required to refine the metrics for productivity, efficiency and effectiveness.

[1]  S. Qureshi,et al.  Activating knowledge through electronic collaboration: vanquishing the knowledge paradox , 2004, IEEE Transactions on Professional Communication.

[2]  Karl G. Jöreskog,et al.  Lisrel 8: User's Reference Guide , 1997 .

[3]  Fred Niederman,et al.  Towards an Instrument to Measure Participants' Perceptions on Facilitation in Group Support Systems Meetings , 2002 .

[4]  Detmar W. Straub,et al.  Validating Instruments in MIS Research , 1989, MIS Q..

[5]  Bruce A. Reinig,et al.  Toward an Understanding of Satisfaction with the Process and Outcomes of Teamwork , 2003, J. Manag. Inf. Syst..

[6]  Robert O. Briggs,et al.  The Yield Shift Theory of Satisfaction and Its Application to the IS/IT Domain , 2008, J. Assoc. Inf. Syst..

[7]  Henry L. Tosi A Theory of Goal Setting and Task Performance , 1991 .

[8]  Poppy Lauretta McLeod,et al.  An Assessment of the Experimental Literature on Electronic Support of Group Work: Results of a Meta-Analysis , 1992, Hum. Comput. Interact..

[9]  J. Crisp,et al.  The Delphi method? , 1997, Nursing research.

[10]  B. Baltes,et al.  Computer-Mediated Communication and Group Decision Making: A Meta-Analysis , 2002 .

[11]  Murray Turoff,et al.  The Delphi Method: Techniques and Applications , 1976 .

[12]  Barbara M. Byrne,et al.  Structural equation modeling with AMOS , 2010 .

[13]  Eileen M. Trauth,et al.  Understanding Computer-Mediated Discussions: Positivist and Interpretive Analyses of Group Support System Use , 2000, MIS Q..

[14]  J. Hair Multivariate data analysis , 1972 .

[15]  Robert O. Briggs,et al.  Bounded Ideation Theory: A New Model of the Relationship Between Ideaquantity and Idea-quality during Ideation , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[16]  Victoria K. Clawson,et al.  The Role of the Facilitator in Computer-Supported Meetings , 1993 .

[17]  R. Briggs,et al.  Meeting Satisfaction for Technology-Supported Groups , 2006 .

[18]  G. Grossman,et al.  Innovation and growth in the global economy , 1993 .

[19]  Alan R. Dennis,et al.  Investigating the Moderators of the Group Support Systems Use with Meta-Analysis , 2002, J. Manag. Inf. Syst..

[20]  Starr Roxanne Hiltz,et al.  Group Support Systems: A Descriptive Evaluation of Case and Field Studies , 2000, J. Manag. Inf. Syst..

[21]  Craig K. Tyran,et al.  GSS and learning research: a review and assessment of the early studies , 1998, Proceedings of the Thirty-First Hawaii International Conference on System Sciences.

[22]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[23]  Gary Klein,et al.  Supervisor Support and Career Anchor Impact on the Career Satisfaction of the Entry-Level Information Systems Professional , 1999, J. Manag. Inf. Syst..

[24]  M. Hwang Did Task Type Matter in the Use of Decision Room GSS? A Critical Review and a Meta-analysis , 1998 .

[25]  P. Drucker,et al.  The age discontinuity. , 1979, Population bulletin.

[26]  Mariëlle den Hengst,et al.  Assessing the Quality of Collaborative Processes , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[27]  Erik de Haan The role of the facilitator , 2005 .

[28]  Matthew K. O. Lee,et al.  A proposed model and measurement instrument for the formation of IS satisfaction: the case of end-user computing satisfaction , 2000, ICIS.

[29]  Robert O. Briggs,et al.  Defining Key Concepts for Collaboration Engineering , 2006, AMCIS.

[30]  E.A.J.A. Rouwette,et al.  Choice criteria for facilitation techniques , 2006 .

[31]  J. M. Cortina,et al.  What Is Coefficient Alpha? An Examination of Theory and Applications , 1993 .

[32]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[33]  Douglas R. Vogel,et al.  Fifteen years of GSS in the field: a comparison across time and national boundaries , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[34]  Robert Davison,et al.  An instrument for measuring meeting success: revalidation and modification , 1999, Inf. Manag..

[35]  Starr Roxanne Hiltz,et al.  An Assessment of Group Support Systems Experimental Research: Methodology and Results , 1998, J. Manag. Inf. Syst..

[36]  John P. Meyer,et al.  Commitment in the workplace: toward a general model , 2001 .

[37]  M. Browne,et al.  Alternative Ways of Assessing Model Fit , 1992 .

[38]  Alan R. Dennis,et al.  Understanding Fit and Appropriation Effects in Group Support Systems via Meta-Analysis , 2001, MIS Q..