New Views of Student Learning: Implications for Educational Measurement.

Abstract : Recent research in cognitive psychology has drawn attention to the important role that students' personal understandings and representations of subject matter play in the learning process. This paper briefly reviews some of this research, and contrasts the kind of learning that results in an individual's changed conception or view of a phenomenon with the more passive, additive kind of learning assessed by most traditional achievement tests. To be consistent with a view of learning as an active, constructive process, educational tests are required which focus on key concepts in an area of learning, and which take into account the variety of types and levels of understanding that students have of those concepts. In these tests, scoring responses right and wrong is likely to be less appropriate than using students' answers to infer their levels of understanding. This will require not only imaginative new types of test items, but statistical models that permit inferences about students' understandings once their responses have been observed. Psychometric approaches are sketched to construct measures of achievement from such tests.

[1]  R. Driver,et al.  Pupils and Paradigms: a Review of Literature Related to Concept Development in Adolescent Science Students , 1978 .

[2]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[3]  Robert J. Mislevy,et al.  TOWARD A TEST THEORY FOR ASSESSING STUDENT UNDERSTANDING , 1991 .

[4]  H. Simon,et al.  Perception in chess , 1973 .

[5]  F. Marton.  Phenomenography — Describing conceptions of the world around us , 1981 .

[6]  Timothy A. Post,et al.  Problem-Solving Skill in the Social Sciences , 1983 .

[7]  G. Masters.  A rasch model for partial credit scoring , 1982 .

[8]  L. E. Klopfer,et al.  Factors influencing the learning of classical mechanics , 1980 .

[9]  John K. Gilbert,et al.  A technique for exploring students' views of the world , 1980 .

[10]  D. Gentner,et al.  Flowing waters or teeming crowds: Mental models of electricity , 1982 .

[11]  Robert M. Gagné,et al.  Presidential address of division 15 learning hierarchies , 1968 .

[12]  R. Glaser,et al.  The Acquisition of Perceptual Diagnostic Skill in Radiology. , 1981 .

[13]  P. Hewson,et al.  Accommodation of a scientific conception: Toward a theory of conceptual change , 1982 .

[14]  R. Osborne,et al.  Learning science: A generative process , 1983 .

[15]  P. Nesher.  Learning Mathematics: A Cognitive Perspective. , 1986 .

[16]  N. Frederiksen.  The real test bias: Influences of testing on teaching and learning. , 1984 .

[17]  J. Piaget,et al.  The Growth Of Logical Thinking From Childhood To Adolescence: An Essay On The Construction Of Formal Operational Structures , 1958 .

[18]  James A. Paulson.  Latent Class Representation of Systematic Patterns in Test Responses , 1986 .

[19]  L. Viennot.  Spontaneous Reasoning in Elementary Dynamics. , 1979 .

[20]  Edward Haertel,et al.  An Application of Latent Class Models to Assessment Data , 1984 .

[21]  J. Piaget.  The Growth Of Logical Thinking From Childhood To Adolescence: An Essay On The Construction Of Formal Operational Structures , 1958 .

[22]  G. Masters,et al.  Rating scale analysis , 1982 .

[23]  Benjamin S. Bloom,et al.  Handbook On Formative and Summative Evaluation of Student Learning , 1971 .

[24]  Barbara Y. White,et al.  Sources of Difficulty in Understanding Newtonian Dynamics , 1983, Cogn. Sci..

[25]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[26]  Edward H. Haertel.  Using restricted latent class models to map the skill structure of achievement items , 1989 .

[27]  S. Embretson,et al.  Component Latent Trait Models for Test Design. , 1982 .

[28]  John Seely Brown,et al.  Diagnostic Models for Procedural Bugs in Basic Mathematical Skills , 1978, Cogn. Sci..

[29]  A. Caramazza,et al.  Naive beliefs in “sophisticated” subjects: misconceptions about trajectories of objects , 1981, Cognition.

[30]  M. McCloskey.  Naive Theories of Motion. , 1982 .

[31]  M. R. Novick,et al.  Statistical Theories of Mental Test Scores. , 1971 .

[32]  Andrea A. diSessa,et al.  Unlearning Aristotelian Physics: A Study of Knowledge-Based Learning , 1982, Cogn. Sci..

[33]  C. Mitchell Dayton,et al.  The Nature and Use of State Mastery Models , 1980 .

[34]  James M. Moser,et al.  The Acquisition of Addition and Subtraction Concepts in Grades One through Three. , 1984 .

[35]  Richard Gunstone,et al.  The fluid/gravity correspondence , 2011, 1107.5780.

[36]  Henri Wallon,et al.  The Psychological Development of the Child , 1972 .

[37]  Mark Wilson.  Saltus: A psychometric model of discontinuity in cognitive development. , 1989 .

[38]  Kikumi K. Tatsuoka,et al.  Bug distribution and statistical pattern classification , 1987 .

[39]  Robert J. Mislevy,et al.  Modeling item responses when different subjects employ different solution strategies , 1990 .

[40]  R. Glaser,et al.  The Future of Testing: A Research Agenda for Cognitive Psychology and Psychometrics. , 1981 .

[41]  M. C. Wittrock,et al.  The Generative Learning Model and Its Implications for Science Education. , 1985 .

[42]  M. Wilson.  A Comparison of Deterministic and Probabilistic Approaches to Measuring Learning Structures , 1989 .

[43]  K. Tatsuoka.  Toward an Integration of Item-Response Theory and Cognitive Error Diagnosis. , 1987 .

[44]  R J Mislevy,et al.  Resolving mixtures of strategies in spatial visualization tasks. , 1991, The British journal of mathematical and statistical psychology.

[45]  F. Lord.  Applications of Item Response Theory To Practical Testing Problems , 1980 .

[46]  R. Siegler.  Developmental Sequences within and between Concepts. , 1981 .

[47]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[48]  J. Clement.  Students’ preconceptions in introductory mechanics , 1982 .

[49]  L. McDermott.  Research on conceptual understanding in mechanics , 1984 .

[50]  L. McDermott,et al.  Investigation of student understanding of the concept of acceleration in one dimension , 1981 .

[51]  K. Tatsuoka.  RULE SPACE: AN APPROACH FOR DEALING WITH MISCONCEPTIONS BASED ON ITEM RESPONSE THEORY , 1983 .