Interaction Analysis as a Tool for Supporting Collaboration: An Overview

This chapter constitutes an overview of logfile-based interaction analysis techniques that can be used for the support of Computer Supported Collaborative Learning (CSCL) activities. Interaction analysis is central in the study of CSCL activities, since in such activities through interactions between partners the state of evolving group knowledge is communicated. This interaction is facilitated by tools that allow logging of events that take place, capturing thus information about the content and the process of collaboration. Automated analysis techniques of this information can be developed. The objective of this analysis is often to support participants, in several ways: explicitly, by providing feedback to them in order to regulate their practices, or by making adaptive changes to some aspects of the collaborative setting; or implicitly, by making available to them representations of their activities. This chapter presents the most common approaches used in interaction analysis, while it particularly emphasizes recent innovative efforts to reap the advantages of machine learning techniques in order to overcome common shortcomings of previous approaches.

[1]  Susan C. Herring.  Interactional Coherence in CMC , 1999, J. Comput. Mediat. Commun..

[2]  Janyce Wiebe,et al.  A machine learning approach to assessing knowledge sharing during collaborative learning activities , 2002, CSCL.

[3]  Timothy Koschmann,et al.  Cscl : Theory and Practice of An Emerging Paradigm , 1996 .

[4]  Franz Caspar,et al.  Beurteilerübereinstimmung und Beurteilerreliabilität , 2002 .

[5]  G. Salomon,et al.  When teams do not function the way they ought to , 1989 .

[6]  Stéphanie Buisine,et al.  Quantitative assessment of collaboration , 2010 .

[7]  Nikol Rummel,et al.  Assessing Collaboration Quality in Synchronous CSCL Problem-Solving Activities: Adaptation and Empirical Evaluation of a Rating Scheme , 2009, EC-TEL.

[8]  Robert M. Aiken,et al.  Monitoring computer-based collaborative problem solving , 1995 .

[9]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[10]  Patrick Jermann,et al.  Group mirrors to support interaction regulation in collaborative problem solving , 2008, Comput. Educ..

[11]  Lev Vygotsky.  Mind in society , 1978 .

[12]  Judy Robertson,et al.  BetterBlether: The Design and Evaluation of a Discussion Tool for education , 1998 .

[13]  Maarten De Laat,et al.  Network and content analysis in an online community discourse , 2002, CSCL.

[14]  J. Guilford.  Psychometric methods, 2nd ed. , 1954 .

[15]  Daniel D. Suthers,et al.  Computer-supported collaborative learning: An historical perspective , 2006 .

[16]  Michael J. Baker,et al.  Promoting reflective interactions in a CSCL environment , 1997, J. Comput. Assist. Learn..

[17]  Harvey Mellar,et al.  A methodology for the analysis of patterns of participation within computer mediated communication courses , 1996 .

[18]  Hans Spada,et al.  Barriers and Biases in Computer-Mediated Knowledge Communication , 2005 .

[19]  Tom Rodden,et al.  Populating the application: a model of awareness for cooperative applications , 1996, CSCW '96.

[20]  Alejandra Martínez-Monés,et al.  Combining qualitative evaluation and social network analysis for the study of classroom social interactions , 2003, Comput. Educ..

[21]  T. Koschmann,et al.  CSCL 2 : carrying forward the conversation , 2003 .

[22]  Herre van Oostendorp.  Cognition in a Digital World , 2002 .

[23]  Brian Webb,et al.  Evaluating the Quality of Learning in Computer Supported Co-Operative Learning , 1997, J. Am. Soc. Inf. Sci..

[24]  Nikolaos M. Avouris,et al.  On analysis of collaborative problem solving: an object-oriented approach , 2003, Comput. Hum. Behav..

[25]  B. Weiner.  An attributional theory of achievement motivation and emotion. , 1985, Psychological review.

[26]  Paul Dourish,et al.  Awareness and coordination in shared workspaces , 1992, CSCW '92.

[27]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[28]  Daniel D. Suthers,et al.  A Coached Collaborative Learning Environment for Entity-Relationship Modeling , 2000, Intelligent Tutoring Systems.

[29]  Heinz Mandl,et al.  Facilitating Collaborative Knowledge Construction in Computer-Mediated Learning Environments with Cooperation Scripts , 2005 .

[30]  Hans Spada,et al.  Learning in Humans and Machines , 1995 .

[31]  Howard B. Lee,et al.  Foundations of Behavioral Research , 1973 .

[32]  D. Randy Garrison,et al.  Critical Inquiry in a Text-Based Environment: Computer Conferencing in Higher Education , 1999, Internet High. Educ..

[33]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[34]  M. Beardsley.  Expression and Meaning: Studies in the Theory of Speech Acts , 1981 .

[35]  Alan M. Lesgold,et al.  A Computational Approach to Analyzing Online Knowledge Sharing Interaction , 2003 .

[36]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[37]  Timothy Koschmann,et al.  Paradigm shifts and instructional technology : An introduction , 1996 .

[38]  Nancy Law,et al.  A learnable content & participation analysis toolkit for assessing CSCL learning outcomes and processes , 2007, CSCL.

[39]  Valerie J. Shute,et al.  Intelligent Tutoring Systems: Past, Present, and Future. , 1994 .

[40]  Jeroen Janssen,et al.  Automatic coding of dialogue acts in collaboration protocols , 2008, Int. J. Comput. Support. Collab. Learn..

[41]  Departamento de Ingeniería Eléctrica.  Analysing student interaction processes in order to improve collaboration . The DEGREE approach , 2000 .

[42]  Valerie J. Shute,et al.  Intelligent Tutoring Systems , 2001, Lecture Notes in Computer Science.

[43]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[44]  David Newman,et al.  Evaluating the Quality of Learning in Computer Supported Co-Operative Learning , 1997, J. Am. Soc. Inf. Sci..

[45]  Pm Jenkinson,et al.  Cognitive , 2020, Definitions.

[46]  Jeroen Janssen,et al.  Automatic coding of communication in collaboration protocols , 2006 .

[47]  Stanley Wasserman,et al.  Social Network Analysis: Methods and Applications , 1994, Structural analysis in the social sciences.

[48]  O. Holsti.  Content Analysis for the Social Sciences and Humanities , 1969 .

[49]  Carolyn Penstein Rosé,et al.  New challenges in CSCL: towards adaptive script support , 2008, ICLS.

[50]  P. Dillenbourg,et al.  The evolution of research on collaborative learning , 1996 .

[51]  John Scott.  Social Network Analysis , 1988 .

[52]  Carl Gutwin,et al.  A Descriptive Framework of Workspace Awareness for Real-Time Groupware , 2002, Computer Supported Cooperative Work (CSCW).

[53]  M. Warschauer.  Comparing Face-To-Face and Electronic Discussion in the Second Language Classroom , 2013, CALICO Journal.

[54]  Brian J. Reiser,et al.  Why scaffolding should sometimes make tasks more difficult for learners , 2002, CSCL.

[55]  Klaus Krippendorff,et al.  Content Analysis: An Introduction to Its Methodology , 1980 .

[56]  Georgios Kahrimanis.  Study of correlations between logfile- based metrics of interaction and the quality of synchronous collaboration , 2010 .

[57]  L. Wasserman.  All of Nonparametric Statistics , 2005 .

[58]  Carolyn Penstein Rosé,et al.  Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning , 2008, Int. J. Comput. Support. Collab. Learn..

[59]  Thierry Chanier,et al.  How Social Network Analysis can help to Measure Cohesion in Collaborative Distance-Learning , 2003, CSCL.

[60]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[61]  A. Brown.  Metacognition, executive control, self-regulation, and other more mysterious mechanisms , 1987 .

[62]  W. A. Scott,et al.  Reliability of Content Analysis ; The Case of Nominal Scale Cording , 1955 .

[63]  David Georgina,et al.  Integration of technology in higher education: A review of faculty self-perceptions , 2008, Internet High. Educ..

[64]  Jacki O'Neill,et al.  Text chat in action , 2003, GROUP.

[65]  R. Weber.  Basic Content Analysis , 1986 .

[66]  Mark Pendergast,et al.  GROUP'03 : proceedings of the 2003 International ACM SIGGROUP Conference on Supporting Group Work : November 9-12, 2003, Sundial Resort on Sanibel Island, Florida, USA , 2003 .

[67]  S. Järvelä,et al.  The Levels of Web-Based Discussions: Using Perspective Taking Theory as an Analytical Tool , 2003 .

[68]  F. Weinert,et al.  Metacognition, motivation, and understanding , 1987 .

[69]  Jim Hewitt.  How Habitual Online Practices Affect the Development of Asynchronous Discussion Threads , 2003 .

[70]  Nikolaos Avouris,et al.  Modelling interaction during small-group synchronous problem-solving activities: The Synergo approach . , 2004 .

[71]  D. Garrison.  Critical Thinking and Adult Education: A Conceptual Model for Developing Critical Thinking in Adult Learners. , 1991 .

[72]  Charlotte N. Gunawardena,et al.  Analysis of a Global Online Debate and the Development of an Interaction Analysis Model for Examining Social Construction of Knowledge in Computer Conferencing , 1997 .

[73]  R. Selman.  growth of interpersonal understanding , 1980 .

[74]  F. Fischer,et al.  Collaboration Scripts – A Conceptual Analysis , 2006 .

[75]  A. E. Veldhuis-Diermanse,et al.  Collaborative learning through computer-mediated communication in academic education , 2001 .

[76]  G. Stahl.  Rediscovering CSCL , 2001 .

[77]  Sandra Katz,et al.  Modeling pedagogical interactions with machine learning , 2000, Kognitionswissenschaft.

[78]  Angela Cora Garcia,et al.  The Eyes of the Beholder: Understanding the Turn-Taking System in Quasi-Synchronous Computer-Mediated Communication , 1999 .

[79]  Ulrike Cress,et al.  Learning in the Synergy of Multiple Disciplines, 4th European Conference on Technology Enhanced Learning, EC-TEL 2009, Nice, France, September 29 - October 2, 2009, Proceedings , 2009, EC-TEL.

[80]  Starr Roxanne Hiltz,et al.  Experiments in group decision making, 3: disinhibition, deindividuation, and group process in pen name and real name computer conferences , 1989, Decis. Support Syst..

[81]  Daniel D. Suthers,et al.  An Experimental Study of the Effects of Representational Guidance on Collaborative Learning Processes , 2003 .

[82]  R. Sawyer.  The Cambridge Handbook of the Learning Sciences: Introduction , 2014 .

[83]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[84]  Michael J. Baker,et al.  Computer-Supported Collaborative Learning in the Space of Debate , 2003, CSCL.

[85]  Daniel D. Suthers,et al.  An Empirical Study of the Effects of Representational Guidance on Collaborative Learning. , 2003 .

[86]  Austin Henderson,et al.  Interaction Analysis: Foundations and Practice , 1995 .

[87]  F. Fischer,et al.  A framework to analyze argumentative knowledge construction in computer-supported collaborative learning , 2006, Comput. Educ..

[88]  Erno Lehtinen,et al.  Evaluating CSCL log files by social network analysis , 1999, CSCL.

[89]  G. Salomon.  Distributed cognitions : psychological and educational considerations , 1997 .

[90]  Jan-Willem Strijbos,et al.  A new direction for log file analysis in CSCL: experiences with a spatio-temporal metric , 2005, CSCL.

[91]  Anthony Kaye,et al.  Collaborative Learning Through Computer Conferencing: The Najaden Papers , 2012 .

[92]  Barbara Wasson,et al.  Designing for Change in Networked Learning Environments, Proceedings of the International Conference on Computer Support for Collaborative Learning, CSCL 2003, Bergen, Norway, June 14-18, 2003 , 2003, CSCL.

[93]  Lasse Lipponen,et al.  Exploring foundations for computer-supported collaborative learning , 2002, CSCL.

[94]  Yvonne Rogers,et al.  When the fingers do the talking: A study of group participation with varying constraints to a tabletop interface , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.