Providing effective feedback, monitoring and evaluation to on-line collaborative learning discussions

Learning and knowledge building have become critical competences for people in the knowledge society era. In this paper, we propose a sociolinguistic dialogue model for understanding how learning evolves and how cognitive process is constructed in on-line discussions. The knowledge extracted from this model is used to assess participation behavior, knowledge building and performance. The ultimate purpose is to provide effective feedback, evaluation and monitoring to the discussion process. Seven hundred students from the Open University of Catalonia in Spain participated in this study. Results showed that learning and knowledge building may be greatly enhanced by presenting selected knowledge to learners as for their particular skills exhibited during interaction. In addition, this valuable provision of information is used as a meta cognitive tool for tutors and moderators for monitoring and evaluating the discussion process more conveniently. This contribution presents our conceptual model for interaction management as well as key design guidelines and evaluation results. Implications of this study are remarked and further research directions are proposed.

[1]  Nico Stehr,et al.  Societal transformations, globalisation and the knowledge society , 2007, Int. J. Knowl. Learn..

[2]  Miltiadis D. Lytras,et al.  Web 2.0: The Business Model , 2008 .

[3]  Tammy Schellens,et al.  Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review , 2006, Comput. Educ..

[4]  Miltiadis D. Lytras,et al.  Exploiting semantic web and ontologies for personalised learning services: towards semantic web-enabled learning portals for real learning experiences , 2008, Int. J. Knowl. Learn..

[5]  Tim S. Roberts.  Online Collaborative Learning: Theory and Practice , 2003 .

[6]  A. Martini,et al.  Innovation at the intersection between exploration, exploitation and discontinuity , 2009 .

[7]  Fatos Xhafa,et al.  A layered framework for evaluating on-line collaborative learning interactions , 2006, Int. J. Hum. Comput. Stud..

[8]  C. Chou.  A Model of Learner-Centered Computer-Mediated Interaction for Collaborative Distance Learning C. CANDACE CHOU , 2004 .

[9]  Miguel-Ángel Sicilia,et al.  The Knowledge Society: a manifesto for knowledge and learning , 2005, Int. J. Knowl. Learn..

[10]  Estelle Michinov,et al.  Identifying a transition period at the midpoint of an online collaborative activity: a study among adult learners , 2007, Comput. Hum. Behav..

[11]  Anssi Peräkylä,et al.  Two traditions of interaction research. , 2004, The British journal of social psychology.

[12]  Fatos Xhafa,et al.  Fostering collaborative knowledge building by the effective provision of knowledge about the discussion process , 2009, Int. J. Bus. Intell. Data Min..

[13]  Daniel L. Schwartz,et al.  The Productive Agency that Drives Collaborative Learning , 1998 .

[14]  P. Dillenbourg.  What do you mean by collaborative learning , 1999 .

[15]  J. McGrath.  Time, Interaction, and Performance (TIP) , 1991 .

[16]  Santi Caballé Llobet.  A Computational Model for the Construction of Knowledge-based Collaborative Learning Distributed Applications , 2008 .

[17]  Fatos Xhafa,et al.  A Service-Oriented Platform for the Enhancement and Effectiveness of the Collaborative Learning Process in Distributed Environments , 2007, OTM Conferences.

[18]  Miltiadis D. Lytras,et al.  Semantic Web and Knowledge Management for the health domain: state of the art and challenges for the Seventh Framework Programme (FP7) of the European Union (2007-2013) , 2009, Int. J. Technol. Manag..

[19]  Maria Vargas-Vera,et al.  Automatic extraction of knowledge from student essays , 2005, Int. J. Knowl. Learn..

[20]  Qiyun Wang,et al.  Designing a web-based constructivist learning environment , 2009, Interact. Learn. Environ..

[21]  Sarah Schrire,et al.  Knowledge building in asynchronous discussion groups: Going beyond quantitative analysis , 2006, Comput. Educ..

[22]  P. Fahy.  Online and face-to-face group interaction processes compared using Bales’ Interaction Process Analysis (IPA). , 2006 .

[23]  Victor Kaptelinin,et al.  Group Cognition Computer Support for Building Collaborative Knowledge , 2007 .

[24]  Patricia Ordóñez de Pablos,et al.  Human resource management systems and knowledge management: the key to develop interorganisational teams , 2004 .

[25]  Pierre Dillenbourg,et al.  Collaborative Learning: Cognitive and Computational Approaches , 1999 .

[26]  Herbert H. Clark,et al.  Contributing to Discourse , 1989, Cogn. Sci..

[27]  Janet Macdonald,et al.  Assessing online collaborative learning: process and product , 2003, Comput. Educ..

[28]  Rajesh K. Pillania.  The state of knowledge management in the Indian export sector , 2009 .

[29]  Gerry Stahl,et al.  Group Cognition: Computer Support for Building Collaborative Knowledge (Acting with Technology) , 2006 .

[30]  Thanasis Daradoumis,et al.  Knowledge extraction and representation of collaborative activity through ontology-based and Social Network Analysis technologies , 2009, Int. J. Bus. Intell. Data Min..

[31]  Fatos Xhafa,et al.  CLPL: Providing software infrastructure for the systematic and effective construction of complex collaborative learning systems , 2010, J. Syst. Softw..

[32]  David Masip,et al.  Enabling Automatic Just-in-time Evaluation of In-class Discussions in On-line Collaborative Learning Practices , 2009, J. Digit. Inf. Manag..

[33]  Patricia Ordóñez de Pablos.  Intellectual capital statements: what pioneering firms from Asia and Europe are doing now , 2005, Int. J. Knowl. Learn..

[34]  Miltiadis D. Lytras,et al.  Red Gate Corner: a Web 2.0 prototype for knowledge and learning concerning China business and culture , 2007, Int. J. Knowl. Learn..

[35]  Albert A. Angehrn,et al.  Designing effective collaboration, learning and innovation systems for education professionals , 2009, Int. J. Knowl. Learn..

[36]  Sadhana Puntambekar,et al.  Analyzing collaborative interactions: divergence, shared understanding and construction of knowledge , 2006, Comput. Educ..

[37]  Athanasios Drigas,et al.  Optimised information system reliability techniques for knowledge society acceptance , 2009, Int. J. Knowl. Learn..

[38]  Judith B. Pena-Shaff,et al.  Analyzing student interactions and meaning construction in computer bulletin board discussions , 2004, Comput. Educ..

[39]  Amy Soller,et al.  Supporting Social Interaction in an Intelligent Collaborative Learning System , 2001 .

[40]  Fatos Xhafa,et al.  A Grid-Aware Implementation for Providing Effective Feedback to On-Line Learning Groups , 2005, OTM Workshops.

[41]  Tammy Schellens,et al.  Fostering knowledge construction in university students through asynchronous discussion groups , 2006, Comput. Educ..

[42]  Miltiadis D. Lytras,et al.  Semantic Web applications: a framework for industry and business exploitation - What is needed for the adoption of the Semantic Web from the market and industry , 2008, Int. J. Knowl. Learn..

[43]  Patricia Ordóñez de Pablos,et al.  Learning and Interacting in the Web : Social networks and social software in the Web 2.0 , 2007 .

[44]  Qiyun Wang,et al.  Investigating critical thinking and knowledge construction in an interactive learning environment , 2009, Interact. Learn. Environ..

[45]  Jan-Willem Strijbos,et al.  Content analysis: What are they talking about? , 2006, Comput. Educ..

[46]  Madely du Preez.  Social Web Evolution: Integrating Semantic Applications and Web 2.0 Technologies , 2009 .

[47]  Pierre Dillenbourg,et al.  Chapter 1 (Introduction) What do you mean by 'collaborative learning'? , 1999 .