Content-free collaborative learning modeling using data mining

Modeling user behavior (user modeling) via data mining faces a critical unresolved issue: how to build a collaboration model based on frequent analysis of students in order to ascertain whether collaboration has taken place. Numerous human-based and knowledge-based solutions to this problem have been proposed, but they are time-consuming or domain-dependent. The diversity of these solutions and their lack of common characteristics are an indication of how unresolved this issue remains. Bearing this in mind, our research has made progress on several fronts. First, we have found supportive evidence, based on a collaborative learning experience with hundreds of students over three consecutive years, that an approach using domain independent learning that is transferable to current e-learning platforms helps both students and teachers to manage student collaboration better. Second, the approach draws on a domain-independent modeling method of collaborative learning based on data mining that helps clarify which user-modeling issues are to be considered. We propose two data mining methods that were found to be useful for evaluating student collaboration, and discuss their respective advantages and disadvantages. Three data sources to generate and evaluate the collaboration model were identified. Third, the features being modeled were made accessible to students in several meta-cognitive tools. Their usage of these tools showed that the best approach to encourage student collaboration is to show only the most relevant inferred information, simply displayed. Moreover, these tools also provide teachers with valuable modeling information to improve their management of the collaboration. Fourth, an ontology, domain independent features and a process that can be applied to current e-learning platforms make the approach transferable and reusable. Fifth, several open research issues of particular interest were identified. We intend to address these open issues through research in the near future.

[1]  Antonija Mitrovic,et al.  From Modelling Domain Knowledge to Metacognitive Skills: Extending a Constraint-Based Tutoring System to Support Collaboration , 2007, User Modeling.

[2]  Alejandra Martínez-Monés,et al.  Studying participation networks in collaboration using mixed methods , 2006, Int. J. Comput. Support. Collab. Learn..

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  Alejandra Martínez-Monés,et al.  Supporting Members of a Learning Community Using Interaction Analysis Tools: The Example of the Kaleidoscope NoE Scientific Network , 2008, 2008 Eighth IEEE International Conference on Advanced Learning Technologies.

[5]  Dimitrova,et al.  Detecting Mismatches Between a User's and a System's Conceptualizations to Empower User Modelling for the Semantic Web , 2005 .

[6]  Jia-Sheng Heh,et al.  Analyzing User Behavior Distribution on E-Learning Platform with Techniques of Clustering , 2004 .

[7]  J. Michael Spector,et al.  Handbook of Research on Educational Communications and Technology, 3rd Edition , 2012 .

[8]  Mehrdad Jalali,et al.  Expectation maximization clustering algorithm for user modeling in web usage mining system , 2009 .

[9]  Laurie P. Dringus,et al.  Temporal transitions in participation flow in an asynchronous discussion forum , 2010, Comput. Educ..

[10]  Judy Kay,et al.  Metacognition and Open Learner Models , 2008 .

[11]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User Modeling and User-Adapted Interaction.

[12]  Gordon I. McCalla,et al.  The Massive User Modelling System (MUMS) , 2004, Intelligent Tutoring Systems.

[13]  Ryan Shaun Joazeiro de Baker,et al.  Off-task behavior in the cognitive tutor classroom: when students "game the system" , 2004, CHI.

[14]  M. Felisa Verdejo,et al.  Applications of a Collaborative Learning Ontology , 2002, MICAI.

[15]  Jesus Boticario,et al.  Clustering learners according to their collaboration , 2009, 2009 13th International Conference on Computer Supported Cooperative Work in Design.

[16]  Guillermo Vega Gorgojo,et al.  Conceptual framework for design, technological support and evaluation of collaborative learning , 2009 .

[17]  Rose Dieng,et al.  Towards an Ontology for Knowledge Management in Communities of Practice , 2006, PAKM.

[18]  Tharrenos Bratitsis,et al.  INDICATORS FOR MEASURING QUALITY IN ASYNCHRONOUS DISCUSSION FORAE , 2006 .

[19]  Ulrike Cress,et al.  Learning in the Synergy of Multiple Disciplines, 4th European Conference on Technology Enhanced Learning, EC-TEL 2009, Nice, France, September 29 - October 2, 2009, Proceedings , 2009, EC-TEL.

[20]  Ryan Shaun Joazeiro de Baker,et al.  Mining Data for Student Models , 2010, Advances in Intelligent Tutoring Systems.

[21]  Colin Tattersall,et al.  Encouraging contributions in learning networks using incentive mechanisms , 2005, J. Comput. Assist. Learn..

[22]  Alejandra Martínez-Monés,et al.  Towards an XML-Based Representation of Collaborative Action , 2003, CSCL.

[23]  Crescencio Bravo,et al.  A Method to Classify Collaboration in CSCL Systems , 2007, ICANNGA.

[24]  Winslow Burleson,et al.  Developing creativity, motivation, and self-actualization with learning systems , 2005, Int. J. Hum. Comput. Stud..

[25]  Susan Bull,et al.  Use and Trust of Simple Independent Open Learner Models to Support Learning within and across Courses , 2009, UMAP.

[26]  Alfred Kobsa,et al.  Generic User Modeling Systems , 2001, User modeling and user-adapted interaction.

[27]  Judy Kay Basser Position paper Ontologies for reusable and scrutable student models , 1999 .

[28]  Jan-Willem Strijbos,et al.  Methodological challenges for collaborative learning research , 2007 .

[29]  David W. Johnson,et al.  Cooperation and the Use of Technology , 2007 .

[30]  Barrie Brennan Lifelong Learning and the New Educational Order , 2001 .

[31]  A. Martínez,et al.  An Xml-based Representation of Collaborative Interaction , 2002 .

[32]  J. Boticario,et al.  Helping the tutor to manage a collaborative task in a web-based learning environment , 2003 .

[33]  NGELIQUE D IMITRACOPOULOU,et al.  Computer based Interaction Analysis Supporting Self-regulation : Achievements and Prospects of an Emerging Research Direction A , 2008 .

[34]  Fatos Xhafa,et al.  A layered framework for evaluating on-line collaborative learning interactions , 2006, Int. J. Hum. Comput. Stud..

[35]  J. Boticario,et al.  Why using dotLRN ? UNED use cases , 2007 .

[36]  Michalis Nik Xenos,et al.  Modelling of distance education forum: Formal languages as interpretation methodology of messages in asynchronous text-based discussion , 2009, Comput. Educ..

[37]  Jesus Boticario,et al.  Application of machine learning techniques to analyse student interactions and improve the collaboration process , 2011, Expert Syst. Appl..

[38]  R. Kirk Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[39]  Amy Soller,et al.  Supporting Social Interaction in an Intelligent Collaborative Learning System , 2001 .

[40]  Jesus Boticario,et al.  Towards a Personalized Web-Based Educational System , 2000, MICAI.

[41]  Mihaela Cocea,et al.  Log file analysis for disengagement detection in e-Learning environments , 2009, User Modeling and User-Adapted Interaction.

[42]  Martin Muehlenbrock Formation of Learning Groups by using Learner Profiles and Context Information , 2005, AIED.

[43]  Alfred Kobsa,et al.  Personalised hypermedia presentation techniques for improving online customer relationships , 2001, The Knowledge Engineering Review.

[44]  Mohamed Medhat Gaber,et al.  Learning from Data Streams: Processing Techniques in Sensor Networks , 2007 .

[45]  K. Steffens Self-regulation and computer based learning , 2001 .

[46]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[47]  María José del Jesús,et al.  Evolutionary algorithms for subgroup discovery in e-learning: A practical application using Moodle data , 2009, Expert Syst. Appl..

[48]  Elena Gaudioso,et al.  Mining Student Data To Characterize Similar Behavior Groups In Unstructured Collaboration Spaces , 2004 .

[49]  David N. Chin Empirical Evaluation of User Models and User-Adapted Systems , 2001, User Modeling and User-Adapted Interaction.

[50]  César A. Collazos,et al.  Evaluating Collaborative Learning Processes using System-based Measurement , 2007, J. Educ. Technol. Soc..

[51]  Elena Durán Modelo del Alumno para Sistemas de Aprendizaje Colaborativo , 2006 .

[52]  J. Kay,et al.  Mining learners ’ traces from an online collaboration tool , 2007 .

[53]  Nikol Rummel,et al.  Assessing Collaboration Quality in Synchronous CSCL Problem-Solving Activities: Adaptation and Empirical Evaluation of a Rating Scheme , 2009, EC-TEL.

[54]  Laurie P. Dringus,et al.  Using data mining as a strategy for assessing asynchronous discussion forums , 2005, Comput. Educ..

[55]  Lora Aroyo,et al.  OWL-OLM : interactive ontology-based elicitation of user models , 2005 .

[56]  Thea van der Geest,et al.  User-centered evaluation of adaptive and adaptable systems: a literature review , 2008, The Knowledge Engineering Review.

[57]  Nikol Rummel,et al.  A rating scheme for assessing the quality of computer-supported collaboration processes , 2007, Int. J. Comput. Support. Collab. Learn..

[58]  Dominik Heckmann,et al.  Situation Modeling and Smart Context Retrieval with Semantic Web Technology and Conflict Resolution , 2005, MRC@IJCAI.

[59]  南澤 由香里,et al.  書評 フィールド・J著『生涯学習と新しい教育体制』 Field, J., 2000, Lifelong Learning and The New Educational Order, Staffordshire, Trentham Books(=矢野裕俊・埋橋孝文・赤尾勝己・伊藤智子訳) 学文社、2004年 , 2005 .

[60]  Sebastián Ventura,et al.  Educational Data Mining: A Review of the State of the Art , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[61]  Antonio R Anaya,et al.  Ranking learner collaboration according to their interactions , 2010, IEEE EDUCON 2010 Conference.

[62]  Alejandra Martínez-Monés,et al.  From Mirroring to Guiding: A Review of State of the Art Technology for Supporting Collaborative Learning , 2005, Int. J. Artif. Intell. Educ..

[63]  Riichiro Mizoguchi The role of ontological engineering for AIED research , 2005, Comput. Sci. Inf. Syst..

[64]  Jan Wessnitzer,et al.  A Model of Non-elemental Associative Learning in the Mushroom Body Neuropil of the Insect Brain , 2007, ICANNGA.

[65]  Chan Jung Park,et al.  Comparison of Two Learning Models for Collaborative e-Learning , 2006, Edutainment.

[66]  Olga C. Santos,et al.  Integration of Educational Specifications and Standards to Support Adaptive Learning Scenarios in ADAPTAPlan , 2008, Int. J. Comput. Sci. Appl..

[67]  Félix Hernández-del-Olmo,et al.  Supporting teachers in collaborative student modeling: A framework and an implementation , 2009, Expert Syst. Appl..