Resources Sequencing Using Automatic Prerequisite--Outcome Annotation

The objective of any tutoring system is to provide resources to learners that are adapted to their current state of knowledge. With the availability of a large variety of online content and the disjunctive nature of results provided by traditional search engines, it becomes crucial to provide learners with adapted learning paths that propose a sequence of resources that match their learning objectives. In an ideal case, the sequence of documents provided to the learner should be such that each new document relies on concepts that have been already defined in previous documents. Thus, the problem of determining an effective learning path from a corpus of web documents depends on the accurate identification of outcome and prerequisite concepts in these documents and on their ordering according to this information. Until now, only a few works have been proposed to distinguish between prerequisite and outcome concepts, and to the best of our knowledge, no method has been introduced so far to benefit from this information to produce a meaningful learning path. To this aim, this article first describes a concept annotation method that relies on machine-learning techniques to predict the class of each concept—prerequisite or outcome—on the basis of contextual and local features. Then, this categorization is exploited to produce an automatic resource sequencing on the basis of different representations and scoring functions that transcribe the precedence relation between learning resources. Experiments conducted on a real dataset built from online resources show that our concept annotation approach outperforms the baseline method and that the learning paths automatically generated are consistent with the ground truth provided by the author of the online content.

[1]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[2]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[3]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[4]  Demetrios G. Sampson,et al.  Adaptive Learning Resources Sequencing in Educational Hypermedia Systems , 2005, J. Educ. Technol. Soc..

[5]  Yiming Yang,et al.  RCV1: A New Benchmark Collection for Text Categorization Research , 2004, J. Mach. Learn. Res..

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  FischerStephan Course and exercise sequencing using metadata in adaptive hypermedia learning systems , 2001 .

[8]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[9]  Gregory N. Hullender,et al.  Learning to rank using gradient descent , 2005, ICML.

[10]  Filip Radlinski,et al.  A support vector method for optimizing average precision , 2007, SIGIR.

[11]  Ronald Fagin,et al.  Comparing top k lists , 2003, SODA '03.

[12]  Jaime G. Carbonell,et al.  Fast learning of document ranking functions with the committee perceptron , 2008, WSDM '08.

[13]  Johanna Völker,et al.  A Framework for Ontology Learning and Data-driven Change Discovery , 2005 .

[14]  Javed I. Khan,et al.  A Technique for Representing Course Knowledge Using Ontologies and Assessing Test Problems , 2007, AWIC.

[15]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[16]  John C. Thomas,et al.  Dynamic assembly of learning objects , 2004, WWW Alt. '04.

[17]  Jian Pei,et al.  CMAR: accurate and efficient classification based on multiple class-association rules , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[18]  D. Ausubel The psychology of meaningful verbal learning. , 1963 .

[19]  Bernadette Bouchon-Meunier,et al.  Automatic concept type identification from learning resources , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[20]  Wolfgang Nejdl,et al.  Ontologies and Metadata for eLearning , 2004, Handbook on Ontologies.

[21]  Peter Brusilovsky,et al.  An Adaptive E-Learning Service for Accessing Interactive Examples , 2004 .

[22]  Peter Brusilovsky,et al.  Concept-Based Courseware Engineering for Large Scale Web-based Education , 2000, WebNet.

[23]  Ethem Alpaydin,et al.  Multiple Kernel Learning Algorithms , 2011, J. Mach. Learn. Res..

[24]  Jianfeng Gao,et al.  Linear discriminant model for information retrieval , 2005, SIGIR '05.

[25]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[26]  Marc Roubens,et al.  Fuzzy Preference Modelling and Multicriteria Decision Support , 1994, Theory and Decision Library.

[27]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[28]  John Seely Brown,et al.  Intelligent Tutoring Systems , 2016, Lecture Notes in Computer Science.

[29]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[30]  Tie-Yan Liu,et al.  Adapting ranking SVM to document retrieval , 2006, SIGIR.

[31]  Julita Vassileva Dynamic Courseware Generation: at the Cross Point of CAL, ITS and Authoring , 1995 .

[32]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[33]  Hai Yang,et al.  ACM Transactions on Intelligent Systems and Technology - Special Section on Urban Computing , 2014 .

[34]  Fabio Ciravegna,et al.  (LP) 2 , an Adaptive Algorithm for Information Extraction from Web-related Texts , 2001 .

[35]  Wolfgang Nejdl,et al.  A logical characterization of adaptive educational hypermedia , 2004, New Rev. Hypermedia Multim..

[36]  Thore Graepel,et al.  Large Margin Rank Boundaries for Ordinal Regression , 2000 .

[37]  Peter Brusilovsky,et al.  ELM-ART: An Intelligent Tutoring System on World Wide Web , 1996, Intelligent Tutoring Systems.

[38]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[39]  Stephan Fischer,et al.  Course and exercise sequencing using metadata in adaptive hypermedia learning systems , 2001, JERC.

[40]  Mark Levene,et al.  Search Engines: Information Retrieval in Practice , 2011, Comput. J..

[41]  Mia Stern,et al.  Curriculum Sequencing in a Web-Based Tutor , 1998, Intelligent Tutoring Systems.

[42]  Sudeshna Sarkar,et al.  Automatic Extraction of Pedagogic Metadata from Learning Content , 2008, Int. J. Artif. Intell. Educ..

[43]  Eric Brill,et al.  A Simple Rule-Based Part of Speech Tagger , 1992, HLT.

[44]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[45]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[46]  Nicolas Labroche,et al.  Distinguishing defined concepts from prerequisite concepts in learning resources , 2011, 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).