Measuring Arithmetic Word Problem Complexity through Reading Comprehension and Learning Analytics

Numerous studies have addressed the relationship between performance in mathematics problem-solving and reading comprehension in students of all educational levels. This work presents a new proposal to measure the complexity of arithmetic word problems through the student reading comprehension of the problem statement and the use of learning analytics. The procedure to quantify this reading comprehension comprises two phases: (a) the division of the statement into propositions and (b) the computation of the time dedicated to read each proposition through a technological environment that records the interactions of the students while solving the problem. We validated our approach by selecting a collection of problems containing mathematical concepts related to fractions and their different meanings, such as fractional numbers over a natural number, basic mathematical operations with a natural whole or fractional whole and the fraction as an operator. The main results indicate that a student’s reading time is an excellent proxy to determine the complexity of both propositions and the complete statement. Finally, we used this time to build a logistic regression model that predicts the success of students in solving arithmetic word problems.

[1]  K. W. Hunt.  Syntactic maturity in schoolchildren and adults. , 1970, Monographs of the Society for Research in Child Development.

[2]  G. Gómez García,et al.  Teacher Training in Lifelong Learning—The Importance of Digital Competence in the Encouragement of Teaching Innovation , 2020, Sustainability.

[3]  Margaret B. Moyer,et al.  Story Problem Formats: Drawn versus Verbal versus Telegraphic. , 1984 .

[4]  George Siemens,et al.  Let’s not forget: Learning analytics are about learning , 2015 .

[5]  Alexandre Perera-Lluna,et al.  Applying learning analytics to students' interaction in business simulation games. The usefulness of learning analytics to know what students really learn , 2019, Comput. Hum. Behav..

[6]  Mariam Jean Dreher,et al.  What Will Be the Demands of Literacy in the Workplace in the Next Millennium , 2000 .

[7]  Anton J. H. Boonen,et al.  The role of visual representation type, spatial ability, and reading comprehension in word problem solving: An item-level analysis in elementary school children , 2014 .

[8]  M. Hegarty,et al.  Comprehension of arithmetic word problems: A comparison of successful and unsuccessful problem solvers. , 1995 .

[9]  K. Stanovich,et al.  Early reading acquisition and its relation to reading experience and ability 10 years later. , 1997, Developmental psychology.

[10]  Juan-Manuel Trujillo-Torres,et al.  Systematic Review of Good Teaching Practices with ICT in Spanish Higher Education. Trends and Challenges for Sustainability , 2019, Sustainability.

[11]  Walt Detmar Meurers,et al.  Word problems: a review of linguistic and numerical factors contributing to their difficulty , 2015, Front. Psychol..

[12]  Stephen J. Pape,et al.  Middle School Children's Problem-Solving Behavior: A Cognitive Analysis from a Reading Comprehension Perspective , 2004 .

[13]  Sebastián Ventura,et al.  Data mining in course management systems: Moodle case study and tutorial , 2008, Comput. Educ..

[14]  Kaisa Aunola,et al.  The association between mathematical word problems and reading comprehension , 2008 .

[15]  Stephen K. Reed,et al.  A structure-mapping model for word problems. , 1987 .

[16]  L. Aiken.  VERBAL FACTORS AND MATHEMATICS LEARNING: A REVIEW OF RESEARCH , 1971 .

[17]  James G. Greeno,et al.  Developmental analysis of understanding language about quantities and of solving problems. , 1988 .