Evaluation on text categorization for mathematics application questions

In learning environments, developing intelligent systems that can properly respond learners' emotions is a critial issue for improving learning outcome. For example, systems should consider to replace the current question with an easier one when detecting negative emotions expressed by learners. Conversely, systems can try to retrieve a more challenging question when learners have contempt emotion or feel bored. This paper proposes the use of text categorization to automatically classify mathematics application questions into different difficulty levels. Applications can then benefit from such classification results to develop retrieval systems for proposing questions based on learners' emotion states. Experimental results show that the machine learning algorithm C4.5 achieved the highest accuracy 78.53% in a binary classification task.

[1]  Pei-Chann Chang,et al.  Detecting causality from online psychiatric texts using inter-sentential language patterns , 2012, BMC Medical Informatics and Decision Making.

[2]  Liang-Chih Yu,et al.  Mining association language patterns using a distributional semantic model for negative life event classification , 2011, J. Biomed. Informatics.

[3]  John Benedict du Boulay,et al.  A tutoring system using an emotion-focused strategy to support learners , 2010 .

[4]  Joe Carthy,et al.  Investigating Statistical Techniques for Sentence-Level Event Classification , 2008, COLING.

[5]  Arthur C. Graesser,et al.  Toward an Affect-Sensitive AutoTutor , 2007, IEEE Intelligent Systems.

[6]  Chung-Hsien Wu,et al.  Annotation and verification of sense pools in OntoNotes , 2010, Inf. Process. Manag..

[7]  Keh-Jiann Chen,et al.  A Bottom-up Merging Algorithm for Chinese Unknown Word Extraction , 2003, SIGHAN.

[8]  John H. L. Hansen,et al.  Dialect Classification for Online Podcasts Fusing Acoustic and Language Based Structural and Semantic Information , 2008, ACL.

[9]  Liang-Chih Yu,et al.  Independent component analysis for near-synonym choice , 2013, Decis. Support Syst..

[10]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[11]  Loyola Heights,et al.  The Relationships Between Sequences of Affective States and Learner Achievement , 2010 .

[12]  Yuval Marom,et al.  Experiments with Sentence Classification , 2006, ALTA.

[13]  Chengqing Zong,et al.  Multi-domain Sentiment Classification , 2008, ACL.

[14]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.