Determining Relations Between Core Dimenisons of Collaboration Quality: A Multidimensional Scaling Approach

Computer Supported Collaborative Learning (CSCL) constitutes one of the most extensively developed paradigms of research and practice in intelligent networking and collaborative systems technology. Interdisciplinarity in the research field involves the application of several methodological approaches towards analysis of CSCL that range from deep-level qualitative analyses of small interaction-rich episodes of collaboration, to quantitative measures of suitably categorized events of interaction that are used as indicators of the success of collaboration in some of its facets [1]. This article adopts an alternative approach to CSCL analysis that aims at taking advantage of some desired properties of each of these diverse methodological trends, involving the use of a rating scheme for the assessment of collaboration quality [2,3]. After defining a set of dimensions that cover the most important aspects of collaboration, it employs appropriately trained human agents to assign ratings of collaboration quality to each dimension, basing their assessments on substantial aspects of collaboration that are not easily formal sable. The activities studied here regard 228 collaborating dyads, working synchronously on a computer science problem-solving task with the use of the Synergo tool [4]. Based on this large dataset, relations between dimensions of collaboration quality are unraveled on empirical grounds, based on the ratings of collaboration quality that were elaborated statistically using a multidimensional scaling technique [5,6,7,8,9,10,11]. Results obtained are in accordance with the initial design of the rating scheme used, and further particularize the relations between the dimensions it defines.

[1]  J. Roschelle Learning by Collaborating: Convergent Conceptual Change , 1992 .

[2]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[3]  W. Grove Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[4]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[5]  Nikolaos Avouris,et al.  Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach . , 2004 .

[6]  J. Kruskal Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis , 1964 .

[7]  J. Leeuw Applications of Convex Analysis to Multidimensional Scaling , 2000 .

[8]  Forrest W. Young,et al.  Introduction to Multidimensional Scaling: Theory, Methods, and Applications , 1981 .

[9]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[10]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[11]  Willem J. Heiser,et al.  13 Theory of multidimensional scaling , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[12]  D. Wegner Transactive Memory: A Contemporary Analysis of the Group Mind , 1987 .

[13]  Myron Wish,et al.  Three-Way Multidimensional Scaling , 1978 .

[14]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[15]  R. Shepard The analysis of proximities: Multidimensional scaling with an unknown distance function. II , 1962 .

[16]  Timothy Koschmann,et al.  Cscl : Theory and Practice of An Emerging Paradigm , 1996 .

[17]  Franz Caspar,et al.  Beurteilerübereinstimmung und Beurteilerreliabilität , 2002 .

[18]  Nikol Rummel,et al.  Assessing Collaboration Quality in Synchronous CSCL Problem-Solving Activities: Adaptation and Empirical Evaluation of a Rating Scheme , 2009, EC-TEL.

[19]  Daniel D. Suthers,et al.  Computer-supported collaborative learning: An historical perspective , 2006 .

[20]  P. Groenen,et al.  Modern multidimensional scaling , 1996 .

[21]  W. Marsden I and J , 2012 .

[22]  K. B. Lloyd,et al.  Flowcharting Techniques , 2002, Encyclopedia of Information Systems.

[23]  D. Cicchetti,et al.  Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behavior. , 1981, American journal of mental deficiency.

[24]  L. Guttman A general nonmetric technique for finding the smallest coordinate space for a configuration of points , 1968 .

[25]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[26]  Carolyn Penstein Rosé,et al.  New challenges in CSCL: towards adaptive script support , 2008, ICLS.

[27]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[28]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[29]  Gerry Stahl,et al.  Sustaining Group Cognition in a Math Chat Environment , 2006, Res. Pract. Technol. Enhanc. Learn..

[30]  Marlene Scardamalia,et al.  Computer Support for Knowledge-Building Communities , 1994 .

[31]  I. Borg Multidimensional similarity structure analysis , 1987 .

[32]  C Bron,et al.  COGNITIVE STRATEGIES AND LOOPING CONSTRUCTS - AN EMPIRICAL-STUDY , 1984 .

[33]  Renan Samurcay The concept of variable in programming-its meaning and use in problem-solving , 1985 .

[34]  F. Fischer,et al.  Being there or being where? Videoconferencing and cooperative learning , 2000 .