An approach to assess the quality of collaboration in technology-mediated design situations

Our objective is to measure and compare the quality of collaboration in technology-mediated design activities. Our position is to consider collaboration as multidimensional. We present a method to assess quality of collaboration which is composed of seven dimensions concerning communication processes such as grounding, coordination processes, task-related processes, symmetry of individual contributions as well as motivational processes. This method is used in a study aiming to compare the quality of collaboration in architectural design. In this experimental study, design situations vary according to technology-mediation - co-presence with an augmented reality (AR) environment versus distance with AR and visio-conferencing -, and according to number of participants - pairs versus groups of four architects -. Our results show that distinctive dimensions of collaboration are affected by the technology mediation and/or the number of co-designers. We discuss these results with respect to technology affordances such as visibility and group factors.

[1]  P. Dillenbourg What do you mean by collaborative learning , 1999 .

[2]  Françoise Détienne,et al.  Collaborative design: Managing task interdependencies and multiple perspectives , 2006, Interact. Comput..

[3]  Judith S. Olson,et al.  Small Group Design Meetings: An Analysis of Collaboration , 1992, Hum. Comput. Interact..

[4]  Judith S. Olson,et al.  Distance Matters , 2000, Hum. Comput. Interact..

[5]  Nikolaos Avouris,et al.  Rating the quality of collaboration during networked problem solving activities , 2008 .

[6]  Pierre Leclercq,et al.  A multi-agent system for the interpretation of architectural sketches , 2004, SBM'04.

[7]  Françoise Détienne,et al.  Changing our view on design evaluation meetings methodology: a study of software technical review meetings , 2004, ArXiv.

[8]  Nikol Rummel,et al.  A new method to assess the quality of collaborative process in CSCL , 2005, CSCL.

[9]  John R. Wilson,et al.  Systematic Usability Evaluation and Design Issues for Collaborative Virtual Environments , 2003, Presence: Teleoperators & Virtual Environments.

[10]  Michael J. Baker,et al.  Articulation entre élaboration de solutions et argumentation polyphonique , 2003, ArXiv.

[11]  Audris Mockus,et al.  An Empirical Study of Speed and Communication in Globally Distributed Software Development , 2003, IEEE Trans. Software Eng..

[12]  Stéphane Safin,et al.  Premières évaluations d'un bureau virtuel pour un processus de conception augmenté , 2005, IHM '05.

[13]  Petra Badke-Schaub,et al.  Résumé of 12 years interdisciplinary empirical studies of engineering design in Germany , 1999 .

[14]  Carl Gutwin,et al.  Task analysis for groupware usability evaluation: Modeling shared-workspace tasks with the mechanics of collaboration , 2003, TCHI.

[15]  Petra Badke-Schaub,et al.  Thinking in design teams - an analysis of team communication , 2002 .

[16]  Michael J. Baker,et al.  Forms of cooperation in dyadic problem-solving , 2002, Rev. d'Intelligence Artif..

[17]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[18]  Françoise Détienne,et al.  Multimodal collaborative activity among architectural designers using an augmented desktop at distance or in collocation , 2008, ECCE '08.

[19]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[20]  Hideaki Kuzuoka,et al.  Fractured Ecologies: Creating Environments for Collaboration , 2003, Hum. Comput. Interact..

[21]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[22]  Françoise Détienne,et al.  A socio-cognitive analysis of online design discussions in an Open Source Software community , 2008, Interact. Comput..

[23]  Kasper Hornbæk,et al.  Current practice in measuring usability: Challenges to usability studies and research , 2006, Int. J. Hum. Comput. Stud..

[24]  Stéphane Safin,et al.  Impact d’un environnement d’esquisses virtuelles et d’un modèle 3D précoce sur l’activité de conception architecturale. , 2007 .