When to say "Enough is Enough!"

Organizations conduct series of face-to-face meetings aiming to improve work practices. In these meetings, participants from different backgrounds collaboratively design artifacts, such as knowledge or process maps. Such meetings are orchestrated and carried out by facilitators and the success of the meetings almost solely depends on the experience of the facilitators. Previous research has mainly focused on approaches that support facilitators and participants in the upfront planning of such events. There is however, little guidance for facilitators and participants once a meeting has started. One critical aspect -- among others -- is that during a meeting, the facilitator and participants need to decide for how long the iterative process of discussion and design should continue. We argue that we can provide support for such decisions based on the evolution of artifacts collaboratively created during such meetings. This paper presents a multi-level, multi-method analysis of artifacts based on experts' observations in combination with network analytics. We study the use of automated analytics to assess the evolution of collaboratively created artifacts and to indicate maturity and established consensus of the collaborative practice. We propose a computational approach to support facilitators and participants in deciding when to stop face-to-face meetings.

[1]  Tobias Hecking,et al.  Two Make a Network: Using Graphs to Assess the Quality of Collaboration of Dyads , 2014, CRIWG.

[2]  William M. K. Trochim,et al.  An introduction to concept mapping for planning and evaluation. , 1989 .

[3]  Jac A. M. Vennix,et al.  Group model building effectiveness: a review of assessment studies † , 2002 .

[4]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[5]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[6]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[7]  Michael Rosemann,et al.  Factors and measures of business process modelling: model building through a multiple case study , 2005, Eur. J. Inf. Syst..

[8]  Jan Mendling,et al.  Foundations of Business Process Modeling , 2010 .

[9]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[10]  Thomas Herrmann SeeMe in a nutshell - the semi-structured, socio- technical Modeling Method , 2006 .

[11]  E. Duval Attention please!: learning analytics for visualization and recommendation , 2011, LAK.

[12]  P. Erdos,et al.  On the evolution of random graphs , 1984 .

[13]  Mariëlle den Hengst,et al.  Collaborative Modeling of Processes: What Facilitation Support Does a Group Need? , 2005, AMCIS.

[14]  Ketil Stølen,et al.  What is model driven architecture , 2003 .

[15]  Nikolaos M. Avouris,et al.  Towards the real-time evaluation of collaborative activities: Integration of an automatic rater of collaboration quality in the classroom from the teacher’s perspective , 2014, Education and Information Technologies.

[16]  Peter Rittgen Group Consensus in Business Process Modeling: A Measure and Its Application , 2013, Int. J. e Collab..

[17]  Brian Whitworth,et al.  Systems Design with the Socio-Technical Walkthrough , 2009 .

[18]  Christopher Andrews,et al.  Space to think: large high-resolution displays for sensemaking , 2010, CHI.

[19]  Robert O. Briggs,et al.  A conceptual foundation of the thinkLet concept for Collaboration Engineering , 2006, Int. J. Hum. Comput. Stud..

[20]  Jan Mendling,et al.  What Makes Process Models Understandable? , 2007, BPM.

[21]  Peter Rittgen Collaborative Modeling: Roles, Activities and Team Organization , 2010, Int. J. Inf. Syst. Model. Des..

[22]  Axel Uhl,et al.  Model-Driven Architecture , 2002, OOIS Workshops.

[23]  Thomas Herrmann,et al.  Awareness Support for Combining Individual and Collaborative Process Design in Co-located Meetings , 2013, Computer Supported Cooperative Work (CSCW).

[24]  Bo Cheng,et al.  An Modified PLSR Method in Prediction , 2021, Journal of Data Science.

[25]  R. Bostrom,et al.  Group Facilitation and Group Support Systems , 1993 .

[26]  Judy Kay,et al.  Modelling symmetry of activity as an indicator of collocated group collaboration , 2011, UMAP'11.

[27]  John Krogstie Model-Based Development and Evolution of Information Systems: A Quality Approach , 2012 .

[28]  Volker Wulf,et al.  Sharing Knowledge and Expertise: The CSCW View of Knowledge Management , 2013, Computer Supported Cooperative Work (CSCW).

[29]  B. Bollobás The evolution of random graphs , 1984 .

[30]  Jan Recker,et al.  Opportunities and constraints: the current struggle with BPMN , 2010, Bus. Process. Manag. J..

[31]  P. Harmon The State of Business Process Management , 2013 .

[32]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[33]  George P. Richardson,et al.  Scripts for group model building , 1997 .

[34]  Thomas Herrmann,et al.  Collaborative Usage and Development of Models: State of the Art, Challenges and Opportunities , 2013, Int. J. e Collab..

[35]  Stijn Hoppenbrouwers,et al.  Assessing Collaborative Modeling Quality Based on Modeling Artifacts , 2010, EIS.

[36]  Brian Whitworth,et al.  Handbook of Research on Socio-Technical Design and Social Networking Systems , 2009 .

[37]  Thomas Herrmann,et al.  Combining Collaborative Modeling with Collaborative Creativity for Process Design , 2014, COOP.

[38]  Thomas Herrmann,et al.  Socio-technical Self-Description as a Means for Projects of Introducing Computer Supported Cooperation , 2007, 2007 40th Annual Hawaii International Conference on System Sciences (HICSS'07).

[39]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[40]  Matthias Dehmer,et al.  A history of graph entropy measures , 2011, Inf. Sci..

[41]  Christos Faloutsos,et al.  Graph evolution: Densification and shrinking diameters , 2006, TKDD.

[42]  George P. Richardson,et al.  Group model building: problem structuring, policy simulation and decision support , 2007, J. Oper. Res. Soc..