Are Automatically Identified Reading Strategies Reliable Predictors of Comprehension?

In order to build coherent textual representations, readers use cognitive procedures and processes referred to as reading strategies; these specific procedures can be elicited through self-explanations in order to improve understanding. In addition, when faced with comprehension difficulties, learners can invoke regulation processes, also part of reading strategies, for facilitating the understanding of a text. Starting from these observations, several automated techniques have been developed in order to support learners in terms of efficiency and focus on the actual comprehension of the learning material. Our aim is to go one step further and determine how automatically identified reading strategies employed by pupils with age between 8 and 11 years can be related to their overall level of understanding. Multiple classifiers based on Support Vector Machines are built using the strategies' identification heuristics in order to create an integrated model capable of predicting the learner's comprehension level.

[1]  Zhenghao Chen,et al.  Tuned Models of Peer Assessment in MOOCs , 2013, EDM.

[2]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[3]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[4]  Danielle S. McNamara,et al.  Handbook of latent semantic analysis , 2007 .

[5]  Arthur C. Graesser,et al.  Coh-Metrix , 2011 .

[6]  Danielle S. McNamara,et al.  iStart: A Web-Based Reading Strategy Intervention That Improves Students's Science Comprehension , 2004, CELDA.

[7]  Ilya M. Goldin,et al.  Accounting for Peer Reviewer Bias with Bayesian Models , 2012 .

[8]  Mihai Dascalu,et al.  Analyzing Discourse and Text Complexity for Learning and Collaborating - A Cognitive Approach Based on Natural Language Processing , 2013, Studies in Computational Intelligence.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Danielle S. McNamara,et al.  Assessing Cognitively Complex Strategy Use in an Untrained Domain , 2010, Top. Cogn. Sci..

[11]  Thomas François,et al.  Do NLP and machine learning improve traditional readability formulas? , 2012, PITR@NAACL-HLT.

[12]  Stefan Trausan-Matu,et al.  ReaderBench, an Environment for Analyzing Text Complexity and Reading Strategies , 2013, AIED.

[13]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994, Psychological review.

[14]  George A. Miller,et al.  WordNet: A Lexical Database for English , 1995, HLT.

[15]  Susan Nash-Ditzel,et al.  Metacognitive Reading Strategies Can Improve Self-Regulation , 2010 .

[16]  Danielle S. McNamara,et al.  Self-Explanation and Metacognition , 2009 .

[17]  Danielle S. McNamara,et al.  Evaluating Self-Explanations in iSTART , 2007 .

[18]  Richard Watson Todd,et al.  Coherence, cohesion and comments on students’ academic essays , 2007 .

[19]  Danielle S. McNamara,et al.  Training Self Explanation and Reading Strategies , 1999 .

[20]  Mihai Dascalu,et al.  Computational Discourse Analysis , 2014 .

[21]  D. McNamara SERT: Self-Explanation Reading Training , 2004 .

[22]  Philippe Dessus,et al.  Contrôle et régulation de la compréhension : l'acquisition de stratégies de 8 à 11 ans , 2012 .