2007 Presidential Address—The End(s) of Testing

This expanded version of the 2007 Presidential Address for the American Educational Research Association approaches changes in assessment and accountability from the perspective of achieving balance. The author identifies unresolved conceptual and practical issues in the use of assessment in the schools and describes approaches intended to mitigate problems or improve practice. An example is given from formative assessment research that integrates some of these approaches (Center for Research on Evaluation, Standards, and Student Testing, at the University of California, Los Angeles). International examples of performance and assessment are also reviewed. The author suggests that secondary school assessment be modified to focus students on acquiring concrete Qualifications that certify important accomplishments, with a wide choice of Qualification areas. She argues that using concrete accomplishments and restructuring tests will help schools and their students to regain needed balance.

[1]  Identifiers California,et al.  Annual Meeting of the National Council on Measurement in Education , 1998 .

[2]  Bruce W. Tuckman,et al.  Evaluating Instructional Programs , 1979 .

[3]  Gregory K. W. K. Chung,et al.  Linking Assessment and Instruction Using Ontologies , 2003 .

[4]  J. Sweller,et al.  Development of expertise in mathematical problem solving. , 1983 .

[5]  L. R. Novick Analogical transfer, problem similarity, and expertise. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[6]  Vincent Aleven,et al.  An effective metacognitive strategy: learning by doing and explaining with a computer-based Cognitive Tutor , 2002, Cogn. Sci..

[7]  Robert Glaser,et al.  Investigating the Cognitive Complexity of Science Assessments , 1998 .

[8]  K. A. Ericsson,et al.  The Road To Excellence: The Acquisition of Expert Performance in the Arts and Sciences, Sports, and Games , 1996 .

[9]  E. Baker Multiple Measures: Toward Tiered Systems , 2005 .

[10]  L. Darling-Hammond Teacher Quality and Student Achievement: A Review of State Policy Evidence , 2000 .

[11]  E. Baker,et al.  Improving the Equity and Validity of Assessment-based Information Systems , 1999 .

[12]  John G. Proakis Wiley encyclopedia of telecommunications , 2003 .

[13]  Cristina Conati,et al.  Toward Computer-Based Support of Meta-Cognitive Skills: a Computational Framework to Coach Self-Explanation , 2000 .

[14]  Robert Glaser,et al.  Teaching Machines and Programed Learning, II: Data and Directions , 1966 .

[15]  Eva L. Baker,et al.  Learning-based assessments of history understanding , 1994 .

[16]  S. Derry,et al.  Learning from Examples: Instructional Principles from the Worked Examples Research , 2000 .

[17]  E. Baker,et al.  Instructional Sensitivity of a Complex Language Arts Performance Assessment , 2007 .

[18]  John I. Wilson,et al.  National Education Association , 1909, Science.

[19]  D. Laplane Thought and language. , 1992, Behavioural neurology.

[20]  Keith J. Holyoak,et al.  Interdomain Transfer Between Isomorphic Topics in Algebra and Physics , 2004 .

[21]  Jeffrey D. Karpicke,et al.  Test-Enhanced Learning , 2006, Psychological science.

[22]  W.H. Knowles Schools , 1919, Non-Violent Resistance.

[23]  Lorraine M. McDonnell,et al.  Politics, Persuasion, and Educational Testing , 2004 .

[24]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[25]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[26]  Mary James Using assessment for school improvement , 1998 .

[27]  D. Gentner,et al.  Learning and Transfer: A General Role for Analogical Encoding , 2003 .

[28]  Jia Wang,et al.  Improving Formative Assessment Practice with Educational Information Technology. CRESST Report 739. , 2008 .

[29]  R. Linn Educational measurement, 3rd ed. , 1989 .

[30]  Alija Kulenović,et al.  Standards for Educational and Psychological Testing , 1999 .

[31]  Harold F. O'Neil,et al.  Technology Applications in Education: A Learning View , 2002 .

[32]  R. Glaser,et al.  Knowing What Students Know: The Science and Design of Educational Assessment , 2001 .

[33]  Laura Hamilton,et al.  An Approach to Measuring Cognitive Outcomes Across Higher Education Institutions , 2005 .

[34]  Paul W. Richardson The culture of education , 1996 .

[35]  A. Falanga,et al.  Summary and Conclusions , 2009, Pathophysiology of Haemostasis and Thrombosis.

[36]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[37]  R. Atkinson,et al.  Transitioning From Studying Examples to Solving Problems: Effects of Self-Explanation Prompts and Fading Worked-Out Steps. , 2003 .

[38]  A. Beaton Mathematics Achievement in the Primary School Years. IEA's Third International Mathematics and Science Study (TIMSS). , 1996 .

[39]  Margaret Heritage,et al.  Toward a Framework for Using Student Mathematical Representations as Formative Assessments , 2006 .

[40]  Ralph W. Tyler,et al.  Basic Principles of Curriculum and Instruction , 1969 .

[41]  Peter McGoldrick,et al.  High-tech ways to keep cupboards full. , 2007 .

[42]  J. Sweller,et al.  Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions , 2005 .

[43]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[44]  Michael J. Timms,et al.  The Nature and Impact of Teachers' Formative Assessment Practices. CSE Technical Report 703. , 2006 .

[45]  Steve J. Kramer The HBR List: Breakthrough Ideas for 2010 , 2005 .

[46]  B. Mcgaw The role of the OECD in international comparative studies of achievement , 2008 .

[47]  Pamela R. Aschbacher,et al.  Exploring the Technical Quality of Using Assignments and Student Work as Indicators of Classroom Practice , 2001 .

[48]  David Niemi,et al.  Assessing Conceptual Understanding in Mathematics: Representations, Problem Solutions, Justifications, and Explanations , 1996 .

[49]  R. Catrambone The subgoal learning model: Creating better examples so that students can solve novel problems. , 1998 .

[50]  K. Holyoak,et al.  Overcoming contextual limitations on problem-solving transfer. , 1989 .

[51]  Jill L. Quilici,et al.  Role of examples in how students learn to categorize statistics word problems. , 1996 .

[52]  R. Siegler Microgenetic Studies of Self-Explanation , 2002 .

[53]  K. Holyoak,et al.  Schema induction and analogical transfer , 1983, Cognitive Psychology.

[54]  B. Skinner,et al.  Science and human behavior , 1953 .

[55]  K. Holyoak,et al.  Mathematical problem solving by analogy. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[56]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[57]  Descriptors Educational,et al.  of Educational Measurement , 1988 .

[58]  N. Granott,et al.  Microdevelopment: Transition Processes in Development and Learning , 2009 .

[59]  Matthew W. Lewis,et al.  Self-Explonations: How Students Study and Use Examples in Learning to Solve Problems , 1989, Cogn. Sci..

[60]  Robert J. Mislevy,et al.  The Case for an Integrated Design Framework for Assessing Science Inquiry. CSE Report 638. , 2004 .

[61]  Robert Glaser,et al.  Adaptive Education: Individual Diversity and Learning , 1977 .

[62]  Jill Burstein,et al.  Automated Essay Scoring : A Cross-disciplinary Perspective , 2003 .

[63]  Russell G. Almond,et al.  A cognitive task analysis with implications for designing simulation-based performance assessment☆ , 1999 .

[64]  R. Glaser Advances in Instructional Psychology , 1978 .

[65]  Abeer Alwan,et al.  Speech Coding: Fundamentals and Applications , 2003 .

[66]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .