Three Response Types for Broadening the Conception of Mathematical Problem Solving in Computerized Tests

Three open-ended response types—mathematical expression (ME), generating examples (GE), and graphical modeling (GM)—are described that could broaden the conception of mathematical problem solving used in computerized admissions tests. ME presents single-best-answer problems that call for an algebraic formalism, the correct rendition of which can take an infinite number of surface forms. GE presents loosely structured problems that can have many good answers taking the form of a value, letter pattern, expression, equation, or list. GM asks the examinee to represent a given situation by plotting points on a grid; these items can have a single best answer or multiple correct answers. For the three basic types, sample items are provided, the examinee interfaces and approaches to automated scoring are described, and research results are reported. It is illustrated how ME, GE, and GM can be combined to form extended constructed-response problems, and adescription is offered of how item classes might be used as a basis for creating production-ready scoring keys.

[1]  Gregory K. W. K. Chung,et al.  Computer-Based Collaborative Knowledge Mapping To Measure Team Processes and Team Outcomes. , 1999 .

[2]  Thomas E. Piemme,et al.  Development of a Scoring Algorithm to Replace Expert Rating for Scoring a Complex Performance-Based Assessment , 1997 .

[3]  Gregory K. W. K. Chung,et al.  Reliability and validity of a computer-based knowledge mapping system to measure content understanding , 1999 .

[4]  Gregory K. W. K. Chung,et al.  Computer-based performance assessments: a solution to the narrow measurement and reporting of problem-solving , 1999 .

[5]  Herbert A. Simon,et al.  Information-Processing Theory of Human Problem Solving , 1978 .

[6]  Randy Elliot Bennett,et al.  ON THE MEANINGS OF CONSTRUCTED RESPONSE , 1991 .

[7]  Randy Elliot Bennett,et al.  Generalizability, Validity, and Examinee Perceptions of a Computer‐Delivered Formulating‐Hypotheses Test , 1995 .

[8]  Randy Elliot Bennett,et al.  Evaluating an Automatically Scorable, Open-Ended Response Type for Measuring Mathematical Reasoning in Computer-Adaptive Tests. , 1997 .

[9]  Randy Elliot Bennett,et al.  Validity and Automad Scoring: It's Not Only the Scoring , 1998 .

[10]  A. Su,et al.  The National Council of Teachers of Mathematics , 1932, The Mathematical Gazette.

[11]  N. Frederiksen.  The real test bias: Influences of testing on teaching and learning. , 1984 .

[13]  Paul C. Hardin,et al.  Paper presented at the Annual Meeting of the American , 1999 .

[14]  Sandra P. Marshall,et al.  Schemas in Problem Solving , 1995 .

[15]  Randy Elliot Bennett,et al.  Improving Measurement for Graduate Admissions , 1998 .

[16]  R. Adams,et al.  Construction Versus Choice in Cognitive Measurement , 1995 .

[17]  Eric T. Bradlow,et al.  A Bayesian random effects model for testlets , 1999 .

[18]  R. Bennett,et al.  USING MULTIMEDIA IN LARGE‐SCALE COMPUTER‐BASED TESTING PROGRAMS , 1997 .

[19]  C. Hirsch.  Curriculum and Evaluation Standards for School Mathematics , 1988 .

[20]  Randy Elliot Bennett,et al.  Psychometric and Cognitive Functioning of an Under-Determined Computer-Based Response Type for Quantitative Reasoning , 1999 .

[21]  Brandon Bennett,et al.  Reinventing Assessment: Speculations on the Future of Large Scale Educational Testing , 1998 .

[22]  EXPLORATION OF AN AUTOMATED EDITING TASK AS A GRE® WRITING MEASURE1 , 1999 .

[23]  Randy Elliot Bennett,et al.  Graphical Modeling: A New Response Type for Measuring the Qualitative Component of Mathematical Reasoning , 2000 .

[24]  Martin Chodorow,et al.  Computer Analysis of Essay Content for Automated Score Prediction , 1998 .

[25]  Brent Bridgeman,et al.  A Comparison of Quantitative Questions in Open‐Ended and Multiple‐Choice Formats , 1992 .

[26]  Eva L. Baker,et al.  Testing and Cognition , 1991 .

[27]  Randy Elliot Bennett,et al.  VALIDITY AND AUTOMATED SCORING: IT'S NOT ONLY THE SCORING , 1997 .

[28]  M. Linn,et al.  Emergence and characterization of sex differences in spatial ability: a meta-analysis. , 1985, Child development.