What Works: Creating Adaptive and Intelligent Systems for Collaborative Learning Support

An emerging trend in classrooms is the use of collaborative learning environments that promote lively exchanges between learners in order to facilitate learning. This paper explored the possibility of using discourse features to predict student and group performance during collaborative learning interactions. We investigated the linguistic patterns of group chats, within an online collaborative learning exercise, on five discourse dimensions using an automated linguistic facility, Coh-Metrix. The results indicated that students who engaged in deeper cohesive integration and generated more complicated syntactic structures performed significantly better. The overall group level results indicated collaborative groups who engaged in deeper cohesive and expository style interactions performed significantly better on posttests. Although students do not directly express knowledge construction and cognitive processes, our results indicate that these states can be monitored by analyzing language and discourse. Implications are discussed regarding computer supported collaborative learning and ITS's to facilitate productive communication in collaborative learning environments.

[1]  Arthur C. Graesser,et al.  Computational Analyses of Multilevel Discourse Comprehension , 2011, Top. Cogn. Sci..

[2]  J. Pennebaker,et al.  Lying Words: Predicting Deception from Linguistic Styles , 2003, Personality & social psychology bulletin.

[3]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[4]  Y. Lou,et al.  Small Group and Individual Learning with Technology: A Meta-Analysis , 2001 .

[5]  Andrew J. Scholand,et al.  Assessing Group Interaction with Social Language Network Analysis , 2010, SBP.

[6]  Stephen M. Fiore,et al.  Process mapping and shared cognition: Teamwork and the development of shared problem models. , 2004 .

[7]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[8]  N. Webb.  Peer interaction and learning in small groups , 1989 .

[9]  Omid Noroozi,et al.  Argumentation-Based Computer Supported Collaborative Learning (ABCSCL): A Synthesis of 15 Years of Research. , 2012 .

[10]  Carolyn Penstein Rosé,et al.  Analyzing collaborative learning processes automatically: Exploiting the advances of computational linguistics in computer-supported collaborative learning , 2008, Int. J. Comput. Support. Collab. Learn..

[11]  Marilyn A. Walker,et al.  Towards personality-based user adaptation: psychologically informed stylistic language generation , 2010, User Modeling and User-Adapted Interaction.

[12]  K. Koedinger,et al.  Using Intelligent Tutor Technology to Implement Adaptive Support for Student Collaboration , 2010 .

[13]  Paul Chandler,et al.  Contemporary cognitive load theory research: The good, the bad and the ugly , 2011, Comput. Hum. Behav..

[14]  Jihie Kim,et al.  Can Online Discussion Participation Predict Group Project Performance? Investigating the Roles of Linguistic Features and Participation Patterns , 2013, International Journal of Artificial Intelligence in Education.

[15]  Arthur C. Graesser,et al.  Cohesion Relationships in Tutorial Dialogue as Predictors of Affective States , 2009, AIED.

[16]  Arthur C. Graesser,et al.  Automated Evaluation of Text and Discourse with Coh-Metrix: Coh-Metrix Measures , 2014 .

[17]  Sheng-Yi Wu,et al.  Analyzing the social knowledge construction behavioral patterns of an online synchronous collaborative discussion instructional activity using an instant messaging tool: A case study , 2011, Comput. Educ..

[18]  Jeffrey T. Hancock,et al.  Hungry like the wolf: A word‐pattern analysis of the language of psychopaths , 2013 .

[19]  Heinz Mandl,et al.  Scripting Computer-Supported Collaborative Learning , 2007 .

[20]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[21]  Gerry Stahl,et al.  From Individual Representations to Group Cognition , 2009 .

[22]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[23]  A. King.  Scripting Collaborative Learning Processes: A Cognitive Perspective , 2007 .

[24]  Pierre Dillenbourg,et al.  Sharing Solutions: Persistence and Grounding in Multimodal Collaborative Problem Solving , 2006 .

[25]  P. Robert-Jan Simons,et al.  The affordance of anchored discussion for the collaborative processing of academic texts , 2006, Int. J. Comput. Support. Collab. Learn..

[26]  Stephanie D. Teasley,et al.  Perspectives on socially shared cognition , 1991 .

[27]  F. Fischer,et al.  Fostering collaborative knowledge construction with visualization tools , 2002 .

[28]  Philip M. McCarthy,et al.  Linguistic Features of Writing Quality , 2010 .

[29]  Michael J. Baker,et al.  The role of grounding in collaborative learning tasks , 1999 .

[30]  John Seely Brown,et al.  Intelligent Tutoring Systems , 2016, Lecture Notes in Computer Science.

[31]  J. Pennebaker,et al.  The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods , 2010 .

[32]  Arthur C. Graesser,et al.  Automated Evaluation of Text and Discourse with Coh-Metrix: Introduction , 2014 .

[33]  Arthur C. Graesser,et al.  Coh-Metrix , 2011 .

[34]  Patricia L. Mabry,et al.  Advances in Social Computing, Third International Conference on Social Computing, Behavioral Modeling, and Prediction, SBP 2010, Bethesda, MD, USA, March 30-31, 2010. Proceedings , 2010, SBP.

[35]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[36]  Gerry Stahl,et al.  Studying Virtual Math Teams , 2010 .

[37]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[38]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[39]  Catherine Snow,et al.  Reading for Understanding: Toward an R&D Program in Reading Comprehension , 2002 .

[40]  Stephen M. Fiore,et al.  Toward an Understanding of Macrocognition in Teams: Predicting Processes in Complex Collaborative Contexts , 2010, Hum. Factors.

[41]  Beverly Park Woolf,et al.  Supporting Social Deliberative Skills in Online Classroom Dialogues: Preliminary Results Using Automated Text Analysis , 2012, ITS.

[42]  Allyson Hadwin,et al.  Measurement and assessment in computer-supported collaborative learning , 2010, Comput. Hum. Behav..

[43]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .