Investigating Active Learning for Concept Prerequisite Learning

Concept prerequisite learning focuses on machine learning methods for measuring the prerequisite relation among concepts. With the importance of prerequisites for education, it has recently become a promising research direction. A major obstacle to extracting prerequisites at scale is the lack of large scale labels which will enable effective data driven solutions. We investigate the applicability of active learning to concept prerequisite learning. We propose a novel set of features tailored for prerequisite classification and compare the effectiveness of four widely used query strategies. Experimental results for domains including data mining, geometry, physics, and precalculus show that active learning can be used to reduce the amount of training data required. Given the proposed features, the query-by-committee strategy outperforms other compared query strategies.

[1]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[2]  Jin Tian,et al.  Joint Discovery of Skill Prerequisite Graphs and Student Models , 2016, EDM.

[3]  Richard Scheines,et al.  Discovering Prerequisite Relationships Among Knowledge Components , 2014, EDM.

[4]  Naoki Abe,et al.  Query Learning Strategies Using Boosting and Bagging , 1998, ICML.

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Chengjiang Li,et al.  Prerequisite Relation Learning for Concepts in MOOCs , 2017, ACL.

[7]  Yiming Yang,et al.  Learning Concept Graphs from Online Educational Data , 2016, J. Artif. Intell. Res..

[8]  Doug Downey,et al.  Local and Global Algorithms for Disambiguation to Wikipedia , 2011, ACL.

[9]  Yiming Yang,et al.  Concept Graph Learning from Educational Data , 2015, WSDM.

[10]  Rong Jin,et al.  Active Learning by Querying Informative and Representative Examples , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[12]  Tristan Nixon,et al.  A Method for Finding Prerequisites Within a Curriculum , 2011, EDM.

[13]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[14]  Dana Angluin,et al.  Queries and concept learning , 1988, Machine Learning.

[15]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[16]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[17]  Zhaohui Wu,et al.  Using Prerequisites to Extract Concept Maps fromTextbooks , 2016, CIKM.

[18]  Premkumar Natarajan,et al.  Modeling Concept Dependencies in a Scientific Corpus , 2016, ACL.

[19]  Zhaohui Wu,et al.  Recovering Concept Prerequisite Relations from University Course Dependencies , 2017, AAAI.

[20]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[21]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[22]  Marti A. Hearst Automatic Acquisition of Hyponyms from Large Text Corpora , 1992, COLING.

[23]  Ian H. Witten,et al.  An effective, low-cost measure of semantic relatedness obtained from Wikipedia links , 2008 .

[24]  Jean-Marc Labat,et al.  Discovering Prerequisite Structure of Skills through Probabilistic Association Rules Mining , 2015, EDM.

[25]  Evangelos E. Papalexakis,et al.  Data-Driven Synthesis of Study Plans , 2015 .

[26]  David D. Lewis,et al.  Heterogeneous Uncertainty Sampling for Supervised Learning , 1994, ICML.

[27]  Wenyi Huang,et al.  Measuring Prerequisite Relations Among Concepts , 2015, EMNLP.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  William W. Cohen,et al.  Crowdsourced Comprehension: Predicting Prerequisite Structure in Wikipedia , 2012, BEA@NAACL-HLT.

[30]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.