Rapid cognitive assessment of learners' knowledge structures

Abstract Traditional assessment methods are not always suitable for diagnosing learners' knowledge structures at different levels of their expertise. This paper describes an alternative schema-based rapid assessment technique and its application in the area of arithmetic word problem solving. The technique is based on an assessment of the extent to which working memory limits have been altered by solution schemas held in long-term memory. In an experiment (N = 55, Grade 8), the average test time was reduced by a factor of 2.8 in comparison with a traditional test, with a significant correlation of 0.72 between scores on both tests.

[1]  John R. Anderson,et al.  How people learn to skip steps. , 1996 .

[2]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[3]  Robert J. Mislevy,et al.  Test Theory for A New Generation of Tests , 1994 .

[4]  Slava Kalyuga,et al.  Rapid dynamic assessment of expertise to improve the efficiency of adaptive e-learning , 2005 .

[5]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[6]  Diane J. Briars,et al.  An integrated model of skill in solving elementary word problems cognition and instruction , 1984 .

[7]  J. Sweller.  Evolution of human cognitive architecture , 2003 .

[8]  H. Simon,et al.  Why are some problems hard? Evidence from Tower of Hanoi , 1985, Cognitive Psychology.

[9]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[10]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[11]  Sandra P. Marshall,et al.  Schemas in Problem Solving , 1995 .

[12]  S. Chipman,et al.  Cognitively diagnostic assessment , 1995 .

[13]  John R. Anderson,et al.  Abstract Planning and Perceptual Chunks: Elements of Expertise in Geometry , 1990, Cogn. Sci..

[14]  L. R. Peterson,et al.  Short-term retention of individual verbal items. , 1959, Journal of experimental psychology.

[15]  Fred G. W. C. Paas,et al.  The Efficiency of Instructional Conditions: An Approach to Combine Mental Effort and Performance Measures , 1992 .

[16]  Randy Elliot Bennett,et al.  Item generation and beyond: Applications of schema theory to mathematics assessment. , 2002 .

[17]  Slava Kalyuga,et al.  Measuring Knowledge to Optimize Cognitive Load Factors During Instruction. , 2004 .

[18]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[19]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[20]  Mary S. Riley,et al.  Development of Children's Problem-Solving Ability in Arithmetic. , 1984 .

[21]  Raymond J. Adams,et al.  The Multidimensional Random Coefficients Multinomial Logit Model , 1997 .

[22]  Slava Kalyuga,et al.  The Expertise Reversal Effect , 2003 .

[23]  J. Sweller,et al.  Development of expertise in mathematical problem solving. , 1983 .

[24]  Fred Paas,et al.  Exploring Multidimensional Approaches to the Efficiency of Instructional Conditions , 2004 .

[25]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[26]  Herbert P. Ginsburg,et al.  The development of mathematical thinking , 1983 .

[27]  W Kintsch,et al.  Understanding and solving word arithmetic problems. , 1985, Psychological review.

[28]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[29]  Herbert A. Simon,et al.  Models of Competence in Solving Physics Problems , 1980, Cogn. Sci..