Some implications of expertise research for educational assessment

An educational assessment embodies an argument from a handful of observations of what students say, do or make in a handful of particular circumstances, to what they know or can do in what kinds of situations more broadly. This article discusses ways in which research into the nature and development of expertise can help assessment designers create tasks that address key aspects of targeted learning. Four themes from expertise are presented: organisation of knowledge, social aspects of expertise, knowledge representations and interaction. Ways to develop assessment tasks around these themes are illustrated with examples from applied projects.

[1]  Robert J. Mislevy,et al.  Diagnostic Assessment of Troubleshooting Skill in an Intelligent Tutoring System. , 1994 .

[2]  Guy Claxton.  Education for the Learning Age: A Sociocultural Approach to Learning to Learn , 2008 .

[3]  Paul J. Feltovich,et al.  Categorization and Representation of Physics Problems by Experts and Novices , 1981, Cogn. Sci..

[4]  G. Lakoff,et al.  Metaphors We Live by , 1982 .

[5]  J. Lave.  Cognition in Practice: Outdoors: a social anthropology of cognition in practice , 1988 .

[6]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[7]  Edwin Hutchins,et al.  Distributed Cognition in an Airline Cockpit , 1996 .

[8]  P. Johnson-Laird.  Mental models , 1989 .

[9]  Russell G. Almond,et al.  A cognitive task analysis with implications for designing simulation-based performance assessment☆ , 1999 .

[10]  F. Gobet,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[11]  Dwight Atkinson.  Toward a sociocognitive approach to second Llanguage acquisition , 2002 .

[12]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[13]  Linda S. Steinberg,et al.  Intelligent tutoring and assessment built on an understanding of a technical problem-solving task , 1996 .

[14]  L A Johnson,et al.  A cognitive task analysis for dental hygiene. , 2000, Journal of dental education.

[15]  Peter Szolovits,et al.  What Is a Knowledge Representation? , 1993, AI Mag..

[16]  T. Salthouse.  Expertise as the circumvention of human processing limitations. , 1991 .

[17]  J. Gee.  The Social Mind: Language, Ideology, and Social Practice , 1992 .

[18]  K. A. Ericsson,et al.  The Road To Excellence: The Acquisition of Expert Performance in the Arts and Sciences, Sports, and Games , 1996 .

[19]  Allen Newell,et al.  Human Problem Solving. , 1973 .

[20]  S. Scribner.  Studying working intelligence. , 1984 .

[21]  R. Snow,et al.  Implications of cognitive psychology for educational measurement. , 1989 .

[22]  Russell G. Almond,et al.  On the Structure of Educational Assessments, CSE Technical Report. , 2003 .

[23]  W. Kintsch.  The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[24]  S. Messick.  The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .