A Computer-Based Task for Measuring the Representational Component of Quantitative Proficiency.

In this study, we created a computer-delivered problem-solving task based on the cognitive research literature and investigated its validity for graduate admissions assessment. The task asked examinees to sort mathematical word problem stems according to prototypes. Data analyses focused on the meaning of sorting scores and examinee perceptions of the task. Results showed that those who sorted well tended to have higher GRE General Test scores and college grades than did examinees who sorted less proficiently. Examinees generally preferred this task to multiple-choice items like those found on the General Test's Quantitative section and felt the task was a fairer measure of their ability to succeed in graduate school. Adaptations of the task might be used in admissions tests, as well as for instructional assessments to help lower- scoring examinees localize and remediate problem-solving difficulties.

[1]  H. Simon,et al.  Perception in chess , 1973 .

[2]  Edward A. Silver,et al.  STUDENT PERCEPTIONS OF RELATEDNESS AMONG MATHEMATICAL VERBAL PROBLEMS , 1979 .

[3]  Edward A. Silver,et al.  Recall of Mathematical Problem Information: Solving Related Problems. , 1981 .

[4]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[5]  D. Herrmann,et al.  Problem perception and knowledge structure in expert and novice mathematical problem solvers. , 1982 .

[6]  Marc M. Sebrechts,et al.  Tracing the evolution of knowledge structures , 1985 .

[7]  Betty Collis.  Reflections on Inequities in Computer Education: Do the Rich Get Richer? , 1985 .

[8]  John Seely Brown,et al.  Process versus Product: A Perspective on Tools for Communal and Informal Electronic Learning , 1985 .

[9]  R. Mayer,et al.  COGNITIVE PSYCHOLOGY AND THE SAT: A REVIEW OF SOME IMPLICATIONS , 1987 .

[10]  David J. McArthur,et al.  Learning Problem-Solving Skills in Algebra , 1987 .

[11]  G. Gliner,et al.  College Students' Organization of Mathematics Word Problems in Relation to Success in Problem Solving. , 1989 .

[12]  Kikumi K. Tatsuoka,et al.  ITEM CONSTRUCTION AND PSYCHOMETRIC MODELS APPROPRIATE FOR CONSTRUCTED RESPONSES , 1991 .

[13]  R. Mislevy.  A Framework for Studying Differences between Multiple-Choice and Free-Response Test Items. , 1991 .

[14]  Marc M. Sebrechts.  A Research Platform for Interactive Performance Assessment in Graduate Education. GRE Board Professional Report No. 90-01P. , 1993 .

[15]  Mark K. Singley,et al.  TOWARD COMPUTER-BASED PERFORMANCE ASSESSMENT IN MATHEMATICS , 1995 .