Evaluating Team Collaboration Quality: The Development and Field Application of a Collaboration Maturity Model

Abstract The quality of collaboration directly affects the quality of an organization’s outcomes and performance. Trends like globalization and increased product and service complexity have pushed organizations to become more and more reliant on collaboration in distributed, cross-disciplinary, cross-cultural, virtual teams. The present research is based on an applied science/engineering (AS/E) research paradigm to address an important class of unsolved problems—measuring the quality of collaboration within and across organizational boundaries. This paper presents a collaboration maturity model (Col-MM) to assess an organization’s team collaboration maturity as a first step toward a generalizable solution to that class of problems. The Col-MM is intended to be sufficiently generic to be applied to different organizational and team settings and usable by practitioners for conducting self-assessments. The Col-MM was developed during a series of focus group meetings with professionals (business unit managers). The model was then piloted and subsequently applied in a field study in an automotive company. This paper reports on the development and field application of the Col-MM. It contributes to the collaboration science literature, theory, and practice through a detailed AS/E study that develops a maturity model and a system for administering it that provides proof of value and effective use in the field.

[1]  Roni Reiter-Palmon A Dialectic Perspective on Problem Identification and Construction , 2009, Industrial and Organizational Psychology.

[2]  Aarnout Brombacher,et al.  Analysis of quality information flows in the product creation process of high-volume consumer products , 2000 .

[3]  R. Stebbins Exploratory research in the social sciences , 2001 .

[4]  I. Nonaka A Dynamic Theory of Organizational Knowledge Creation , 1994 .

[5]  P. M. Wognum,et al.  Infrastructures for collaboration in virtual organisations , 2002, Int. J. Netw. Virtual Organisations.

[6]  Esser,et al.  Alive and Well after 25 Years: A Review of Groupthink Research. , 1998, Organizational behavior and human decision processes.

[7]  P. Coughlan,et al.  Development of a technical innovation audit , 1996 .

[8]  Dorothy E. Leidner,et al.  Leadership Effectiveness in Global Virtual Teams , 2002, J. Manag. Inf. Syst..

[9]  Mariëlle den Hengst,et al.  Assessing the Quality of Collaborative Processes , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[10]  Tom Gross,et al.  Computer-supported cooperative work - concepts and trends , 2006, AIM Conference.

[11]  H. S. Feild,et al.  The Relationship of Group Process Variables and Team Performance , 2002 .

[12]  Jerry N. Luftman Assessing Business-IT Alignment Maturity , 2000, Commun. Assoc. Inf. Syst..

[13]  Paul Benjamin Lowry,et al.  The CMC Interactivity Model: How Interactivity Enhances Communication Quality and Process Satisfaction in Lean-Media Groups , 2009, J. Manag. Inf. Syst..

[14]  Gert-Jan de Vreede,et al.  Exploring the Application and Acceptance of Group Support Systems in Africa , 1998, J. Manag. Inf. Syst..

[15]  Gwendolyn L. Kolfschoten,et al.  A Design Approach for Collaboration Processes: A Multimethod Design Science Study in Collaboration Engineering , 2009, J. Manag. Inf. Syst..

[16]  Hee Beng Kuan Tan,et al.  On Formalization of the Whole-Part Relationship in the Unified Modeling Language , 2003, IEEE Trans. Software Eng..

[17]  Taya M. Malone,et al.  The Future of Work: How the New Order of Business Will Shape Your Organization, Your Management Style and Your Life , 2004 .

[18]  Mike Gregory,et al.  The use of maturity models/grids as a tool in assessing product development capability , 2002, IEEE International Engineering Management Conference.

[19]  Susan R. Fussell,et al.  Multiple Group Coordination in Complex and Dynamic Task Environments: Interruptions, Coping Mechanisms, and Technology Recommendations , 2008, J. Manag. Inf. Syst..

[20]  K. Weick,et al.  Organizing and the Process of Sensemaking , 2005 .

[21]  Kenneth L. Kraemer,et al.  Information Technology and Middle Management Downsizing: A Tale of Two Cities , 1997 .

[22]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[23]  Anne P. Massey,et al.  Getting It Together: Temporal Coordination and Conflict Management in Global Virtual Teams , 2001 .

[24]  B. Rosen,et al.  Overcoming Barriers to Knowledge Sharing in Virtual Teams , 2007 .

[25]  Mayuram S. Krishnan,et al.  Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product Development , 2000 .

[26]  B. Bass,et al.  The Bass handbook of leadership : theory, research, and managerial applications , 2008 .

[27]  Mark C. Paulk,et al.  Capability Maturity Model for Software, Version 1.1 , 1993 .

[28]  Kenneth L. Kraemer,et al.  Exploring the Role of Information Technology in Organizational Downsizing: A Tale of Two American Cities , 2002, Organ. Sci..

[29]  Margaret A. Peteraf The cornerstones of competitive advantage: A resource‐based view , 1993 .

[30]  Pedro Antunes,et al.  Evaluation Methods for Groupware Systems , 2007, CRIWG.

[31]  M. Diehl,et al.  Productivity loss in brainstorming groups: Toward the solution of a riddle. , 1987 .

[32]  Jay F. Nunamaker,et al.  Collaboration Engineering with ThinkLets to Pursue Sustained Success with Group Support Systems , 2003, J. Manag. Inf. Syst..

[33]  Carl Gutwin,et al.  Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration , 2003, TCHI.

[34]  B. Fischhoff,et al.  Judgment and decision making. , 2012, Wiley interdisciplinary reviews. Cognitive science.

[35]  D. Macbeth,et al.  Partnership Sourcing: An Integrated Supply Chain Management Approach , 1994 .

[36]  J. Donald,et al.  Disciplinary differences in knowledge validation , 1995 .

[37]  Chinho Lin,et al.  The construction and application of knowledge navigator model (KNMTM): An evaluation of knowledge management maturity , 2009, Expert Syst. Appl..

[38]  Robert O. Briggs,et al.  Collaboration Engineering: Foundations and Opportunities: Editorial to the Special Issue on the Journal of the Association of Information Systems , 2009, J. Assoc. Inf. Syst..

[39]  John S. Edwards,et al.  Building user commitment to implementing a knowledge management strategy , 2005, Inf. Manag..

[40]  ShawDuncan,et al.  Building user commitment to implementing a knowledge management strategy , 2005 .

[41]  H. Ernst,et al.  How to manage virtual teams , 2009 .

[42]  Salvatore T. March,et al.  Design and natural science research on information technology , 1995, Decis. Support Syst..

[43]  Narayan Ramasubbu,et al.  Leveraging global resources: a process maturity framework for managing distributed development , 2005, IEEE Software.

[44]  Andrea Back,et al.  State-of-the-Art on Maturity Models for Collaboration , 2009 .

[45]  John C. Anderson,et al.  Maturity and its impact on new product development project performance , 2001 .

[46]  Angel Cabrera,et al.  Knowledge-Sharing Dilemmas , 2002 .

[47]  Robert O. Briggs,et al.  On Expanding the Scope of Design Science in IS Research , 2011, DESRIST.

[48]  Rajiv D. Banker,et al.  Understanding the Impact of Collaboration Software on Product Design and Development , 2006, Inf. Syst. Res..

[49]  Kjeld Schmidt,et al.  The organization of cooperative work: beyond the “Leviathan” conception of the organization of cooperative work , 1994, CSCW '94.

[50]  Michael E. McGrath,et al.  Setting the PACE in product development : a guide to product and cycle-time excellence , 1996 .

[51]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[52]  M. Lynne Markus,et al.  Toward A Theory of Knowledge Reuse : Types of Knowledge Reuse Situations and Factors in Reuse Success , 2022 .

[53]  Kevin Crowston,et al.  The interdisciplinary study of coordination , 1994, CSUR.

[54]  Javier P. Gonzalez-Zugasti,et al.  Assessing value in platformed product family design , 2001 .

[55]  Alan R. Hevner,et al.  Design Science Research: Looking to the Future , 2010 .

[56]  Alexander Hars,et al.  Web Based Knowledge Infrastructures for the Sciences: An Adaptive Document , 2000, Commun. Assoc. Inf. Syst..