Semantic Features of Math Problems: Relationships to Student Learning and Engagement

The creation of crowd-sourced content in learning systems is a powerful method for adapting learning systems to the needs of a range of teachers in a range of domains, but the quality of this content can vary. This study explores linguistic differences in teacher-created problem content in ASSISTments using a combination of discovery with models and correlation mining. Specifically, we find correlations between semantic features of mathematics problems and indicators of learning and engagement, suggesting promising areas for future work on problem design. We also discuss limitations of semantic tagging tools within mathematics domains and ways of addressing these limitations.

[1]  David A. Medler,et al.  Distinct Brain Systems for Processing Concrete and Abstract Concepts , 2005, Journal of Cognitive Neuroscience.

[2]  R. W. Zandvoort,et al.  Contributions to English Syntax and Philology , 1963 .

[3]  Emmanuel Morin,et al.  Compositionality and lexical alignment of multi-word terms , 2010, Lang. Resour. Evaluation.

[4]  Mitchell J. Nathan,et al.  How Readability and Topic Incidence Relate to Performance on Mathematics Story Problems in Computer-Based Curricula , 2015 .

[5]  S. Ferketich,et al.  Focus on psychometrics. Aspects of item analysis. , 1991, Research in nursing & health.

[6]  C. O'Malley,et al.  Linguistic-computing methods for analysing digital records of learning , 2006 .

[7]  Janet L. Capps,et al.  Comprehension of pronouns in young and older adults. , 1986 .

[8]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[9]  Patricia Charlton,et al.  Conference on Artificial Intelligence in Education , 2009 .

[10]  Neil T. Heffernan,et al.  The ASSISTments Ecosystem: Building a Platform that Brings Scientists and Teachers Together for Minimally Invasive Research on Human Learning and Teaching , 2014, International Journal of Artificial Intelligence in Education.

[11]  Olga V. Patterson.  Automatic Domain Adaptation of Word Sense Disambiguation Based on Sublanguage Semantic Schemata Applied to Clinical Narrative. , 2012 .

[12]  Nuria Carriedo,et al.  Working Memory, Text Comprehension, and Propositional Reasoning: A New Semantic Anaphora WM Test , 2011, The Spanish journal of psychology.

[13]  Neil T. Heffernan,et al.  Population validity for educational data mining models: A case study in affect detection , 2014, Br. J. Educ. Technol..

[14]  Thomas C. Toppino,et al.  Learning from Tests: The Case of True-False Examinations , 1989 .

[15]  Mary J. Schleppegrell,et al.  The Linguistic Challenges of Mathematics Teaching and Learning: A Research Review , 2007 .

[16]  Natassia Schutz.  How specific is English for Academic Purposes? A look at verbs in business, linguistics and medical research articles , 2013 .

[17]  Neil T. Heffernan,et al.  Detecting Learning Moment-by-Moment , 2011, Int. J. Artif. Intell. Educ..

[18]  Supreeth M. Gowda,et al.  Affective States and State Tests: Investigating How Affect and Engagement during the School Year Predict End-of-Year Learning Outcomes , 2014, J. Learn. Anal..

[19]  A. Graesser,et al.  Dynamics of affective states during complex learning , 2012 .

[20]  Jack Mostow,et al.  Improving the Help Selection Policy in a Reading Tutor that Listens , 2004 .

[21]  Ryan Shaun Joazeiro de Baker,et al.  Sequences of Frustration and Confusion, and Learning , 2013, EDM.

[22]  John M. Swales,et al.  ESP comes of age? - 21 years after 'Some Measurable Characteristics of Modern Scientific Prose' , 1984 .

[23]  Ryan Shaun Joazeiro de Baker,et al.  HART: the human affect recording tool , 2015, SIGDOC.

[24]  Zachary A. Pardos,et al.  Content Learning Analysis Using the Moment-by-Moment Learning Detector , 2012, ITS.

[25]  Kristin M Weingartner,et al.  Readers’ sensitivity to linguistic cues in narratives: How salience influences anaphor resolution , 2004, Memory & cognition.

[26]  Ulrich Heid,et al.  Reference Lists for the Evaluation of Term Extraction Tools , 2012, TKE 2012.

[27]  G. Vigliocco,et al.  The representation of abstract words: why emotion matters. , 2011, Journal of experimental psychology. General.

[28]  M. Erb,et al.  The Concreteness Effect: Evidence for Dual Coding and Context Availability , 2000, Brain and Language.

[29]  Aniket Kittur,et al.  Harnessing the wisdom of crowds in wikipedia: quality through coordination , 2008, CSCW.

[30]  M. Tinker,et al.  Readability of newspaper headlines printed in capitals and in lower case. , 1946, Journal of Applied Psychology.

[31]  Lydia B. Chilton,et al.  Personalized Online Education - A Crowdsourcing Challenge , 2012, HCOMP@AAAI.

[32]  Marie-Claude L'Homme,et al.  Capturing the Lexical Structure in Special Subject Fields with Verbs and Verbal Derivatives. A Model for Specialized Lexicography , 2003 .

[33]  Srayan Datta,et al.  Building a Scientific Concept Hierarchy Database (SCHBase) , 2015, ACL.

[34]  Arthur C. Graesser,et al.  Coh-Metrix: Analysis of text on cohesion and language , 2004, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[35]  Sheida White,et al.  Mining the Text: 34 Text Features That Can Ease or Obstruct Text Comprehension and Use , 2012 .

[36]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[37]  Cindy K. Chung,et al.  The development and psychometric properties of LIWC2007 , 2007 .

[38]  Dawn Archer,et al.  Evaluating Lexical Resources for a Semantic Tagger , 2004, LREC.

[39]  Vincent Aleven,et al.  Educational Software Features that Encourage and Discourage "Gaming the System" , 2009, AIED.

[40]  Patrick Drouin.  Extracting a bilingual transdisciplinary scientific lexicon , 2010 .

[41]  Jerome L. Myers,et al.  Processing an Anaphor When There Is No Antecedent , 2005 .

[42]  Brett van de Sande.  Measuring the moment of learning with an information-theoretic approach , 2013, EDM.

[43]  Arnon Hershkovitz,et al.  The Impact of Off-task and Gaming Behaviors on Learning: Immediate or Aggregate? , 2009, AIED.

[44]  Aniket Kittur,et al.  Crowdsourcing user studies with Mechanical Turk , 2008, CHI.

[45]  James H. Martin.  METABANK: A KNOWLEDGE‐BASE OF METAPHORIC LANGUAGE CONVENTIONS , 1994, Comput. Intell..

[46]  Peter Sawyer,et al.  A Flexible Framework To Experiment With Ontology Learning Techniques , 2007, SGAI Conf..