Role of Working Memory and Strategy-Use in Feedback Effects on children’s Progression in Analogy Solving:an Explanatory Item Response Theory Account

This study contrasted the effects of tutoring, multiple try and no feedback on children’s progression in analogy solving and examined individual differences herein. Feedback that includes additional hints or explanations leads to the greatest learning gains in adults. However, children process feedback differently from adults and effective feedback likely differs between learners with different characteristics or at different stages in the learning process. In this paper multilevel explanatory item response theory models were used to examine individual differences in feedback effects in children’s performance on a computerized pretest-training-posttest assessment of analogical reasoning. The role of working memory and ability level, based on initial strategy-use, were examined in a sample of 999 5–10 year-old children who received either tutoring feedback, multiple tries or no feedback during the training sessions. The results indicate that tutoring feedback leads to the greatest performance gains; however, this was moderated by working memory and ability level. Children who initially used less advanced strategies benefited more from each type of feedback than children who used advanced strategies at pretest. Higher working memory scores were linked to greater benefit from tutoring feedback or no feedback, whereas learning gains in the multiple try condition were not related to working memory. The findings of this study contribute to the growing literature on how to personalize feedback to the learner’s instructional-needs.

[1]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[2]  P. Fayers.  Item Response Theory for Psychologists , 2004, Quality of Life Research.

[3]  L. Ball,et al.  Self-Explanation, Feedback and the Development of Analogical Reasoning Skills: Microgenetic Evidence for a Metacognitive Processing Account , 2005 .

[4]  R. Sternberg,et al.  Unities in inductive reasoning , 1983 .

[5]  Chen-Lin C. Kulik,et al.  The Instructional Effect of Feedback in Test-Like Events , 1991 .

[6]  H. Walberg,et al.  Matthew Effects in Education , 1983 .

[7]  Susanne Narciss,et al.  Designing and Evaluating Tutoring Feedback Strategies for Digital Learning Environments on the Basis of the Interactive Tutoring Feedback Model. , 2013 .

[8]  Drew A. Linzer,et al.  poLCA: An R Package for Polytomous Variable Latent Class Analysis , 2011 .

[9]  Bethany Rittle-Johnson,et al.  Feedback Both Helps and Hinders Learning: The Causal Role of Prior Knowledge , 2016 .

[10]  Lindsey E. Richland,et al.  Early Executive Function Predicts Reasoning Development , 2013, Psychological science.

[11]  Susanne Narciss,et al.  How to design informative tutoring feedback for multi-media learning , 2004 .

[12]  Eric Andres,et al.  Exploring feedback and student characteristics relevant for personalizing feedback strategies , 2014, Comput. Educ..

[13]  L. A. Goodman.  Exploratory latent structure analysis using both identifiable and unidentifiable models , 1974 .

[14]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[15]  W. Heiser,et al.  Dynamic Testing of Analogical Reasoning in 5- to 6-Year-Olds , 2016 .

[16]  Tobias Ley,et al.  Open Learning and Teaching in Educational Communities , 2014, Lecture Notes in Computer Science.

[17]  S. Narciss.  The impact of informative tutoring feedback and self-efficacy on motivation and achievement in concept learning. , 2004, Experimental psychology.

[18]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[19]  John O. Willis,et al.  Wechsler Intelligence Scale for Children–Fourth Edition , 2014 .

[20]  U. Goswami.  Analogical Reasoning: What Develops? A Review of Research and Theory. , 1991 .

[21]  Robert M. French,et al.  Analogical reasoning, control and executive functions: A developmental investigation with eye-tracking , 2016 .

[22]  Orit Zeichner,et al.  Using Technology to Enhance Mathematical Reasoning: Effects of Feedback and Self-Regulation Learning , 2001 .

[23]  S. Narciss.  Feedback Strategies for Interactive Learning Tasks , 2007 .

[24]  Abe D. Hofman,et al.  The estimation of item response models with the lmer function from the lme4 package in R , 2011 .

[25]  Ruth Wylie,et al.  The Self-Explanation Principle in Multimedia Learning , 2014 .

[26]  Zoubeida R. Dagher,et al.  Review of studies on the effectiveness of instructional analogies in science education , 1995 .

[27]  Carol S. Lidz,et al.  Dynamic assessment: An interactional approach to evaluating learning potential. , 1987 .

[28]  Raymond W. Kulhavy,et al.  Feedback complexity and corrective efficiency , 1985 .

[29]  Willem J. Heiser,et al.  Explanatory item response modeling of children's change on a dynamic test of analogical reasoning , 2013 .

[30]  B. Gholson,et al.  Effects of Type and Combination of Feedback upon Conceptual Learning by Children: Implications for Research in Academic Learning , 1979 .

[31]  Fabienne M. Van der Kleij,et al.  Effects of Feedback in a Computer-Based Learning Environment on Students’ Learning Outcomes , 2013 .

[32]  K. Holyoak,et al.  Analogy Use in Eighth-Grade Mathematics Classrooms , 2004 .

[33]  C. Stevenson,et al.  Dynamic Testing: Measuring Inductive Reasoning in Children With Developmental Disabilities and Mild Cognitive Impairments , 2012, Journal of Cognitive Education and Psychology.

[34]  Jutta Kray,et al.  Developmental differences in learning and error processing: evidence from ERPs. , 2009, Psychophysiology.

[35]  Vincent Aleven,et al.  Learner Differences in Hint Processing , 2012, EDM.

[36]  Gary Natriello.  Adaptive Educational Technologies: Tools for Learning and for Learning about Learning. , 2013 .

[37]  Dedre Gentner,et al.  Structure-Mapping: A Theoretical Framework for Analogy , 1983, Cogn. Sci..

[38]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[39]  J. Sweller.  COGNITIVE LOAD THEORY, LEARNING DIFFICULTY, AND INSTRUCTIONAL DESIGN , 1994 .

[40]  Marci S. DeCaro,et al.  When feedback is cognitively-demanding: the importance of working memory capacity , 2015 .

[41]  A. V. van Duijvenvoorde,et al.  Evaluating the Negative or Valuing the Positive? Neural Mechanisms Supporting Feedback-Based Learning across Development , 2008, The Journal of Neuroscience.

[42]  Gail D. Heyman,et al.  The roles of feedback and working memory in children's reference production. , 2016, Journal of experimental child psychology.

[43]  Jean-Pierre Thibaut,et al.  The development of analogy making in children: cognitive load and executive functions. , 2010, Journal of experimental child psychology.

[44]  P. Boeck,et al.  Explanatory item response models : a generalized linear and nonlinear approach , 2004 .

[45]  V. Shute.  Focus on Formative Feedback , 2007 .

[46]  Ilya M. Goldin,et al.  Learner Differences and Hint Content , 2013, AIED.

[47]  R. Siegler,et al.  A microgenetic/cross-sectional study of matrix completion: comparing short-term and long-term change. , 2002, Child development.

[48]  Dena A. Pastor,et al.  The Use of Multilevel Item Response Theory Modeling in Applied Research: An Illustration , 2003 .

[49]  W. Heiser,et al.  Puzzling with potential: Dynamic testing of analogical reasoning in children , 2008 .

[50]  Edward K Vogel,et al.  Reducing failures of working memory with performance feedback. , 2015, Psychonomic bulletin & review.

[51]  Ann L. Brown,et al.  Linking dynamic assessment with school achievement. , 1987 .

[52]  Merel Bakker,et al.  Progression paths in children's problem solving: The influence of dynamic testing, initial variability, and working memory. , 2017, Journal of experimental child psychology.

[53]  S. Gathercole,et al.  A structural analysis of working memory and related cognitive skills in young children. , 2004, Journal of experimental child psychology.

[54]  Larry Ambrose,et al.  The power of feedback. , 2002, Healthcare executive.

[55]  Willem J. Heiser,et al.  Working memory as a moderator of training and transfer of analogical reasoning in children , 2013 .

[56]  Susanne Narciss,et al.  Fostering achievement and motivation with bug-related tutoring feedback in a computer-based training for written subtraction. , 2006 .

[57]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[58]  G. S. Hanna.  Effects of Total and Partial Feedback in Multiple-Choice Testing Upon Learning , 1976 .

[59]  Michelene T. H. Chi,et al.  The Cambridge Handbook of Multimedia Learning: The Self-Explanation Principle in Multimedia Learning , 2005 .

[60]  J. Elliott,et al.  Dynamic testing with tangible electronics: measuring children's change in strategy use with a series completion task. , 2011, The British journal of educational psychology.

[61]  Roy B. Clariana,et al.  A comparison of answer until correct feedback and knowledge of correct response feedback under two conditions of contextualization , 1990 .