Performance-Based Assessment: Lessons From the Health Professions

Performance-based assessment methods have been used in the health professions for centuries, and dozens of studies of their psychometric characteristics have been reported over the past several decades. During that period, the health professions have seen a variety of performance-based assessment methods come and go, and some hard lessons have been learned from the many studies and frequent missteps. This article shares some of those lessons, using four performance-based assessment methods as examples: written clinical simulations (more commonly termed patient management problems), computer-based clinical simulations, oral examinations, and standardized patients (“live” simulations).

[1]  Peter W. Airasian Measurement Driven Instruction: A Closer Look. , 1988 .

[2]  Harry Torrance Notes: Combining Measurement-Driven Instruction With Authentic Assessment: Some Initial Observations of National Assessment in England and Wales , 1993 .

[3]  R. Reznick,et al.  An objective structured clinical examination for the licentiate: report of the pilot project of the Medical Council of Canada , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[4]  Stephen B. Dunbar,et al.  Complex, Performance-Based Assessment: Expectations and Validation Criteria , 1991 .

[5]  D. Newble,et al.  The effect of assessments and examinations on the learning of medical students , 1983, Medical education.

[6]  John J. Cannell,et al.  Nationally Normed Elementary Achievement Testing in America's Public Schools: How All 50 States Are Above the National Average , 1988 .

[7]  Christine H. McGuire,et al.  SIMULATION TECHNIQUE IN THE MEASUREMENT OF PROBLEM‐SOLVING SKILLS1 , 1967 .

[8]  R. Harden,et al.  Assessment of clinical competence using objective structured examination. , 1975, British medical journal.

[9]  H. Schmidt,et al.  A Cognitive Perspective on Medical Expertise: Theory and Implications , 1990 .

[10]  Eva L. Baker,et al.  Assessing Writing Portfolios: issues in the Validity and Meaning of Scores , 1993 .

[11]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[12]  R. Shavelson Performance Assessments: Political Rhetoric and Measurement Reality , 1992 .

[13]  H. A. Carithers Measuring Medical Education. , 1972 .

[14]  H. Barrows,et al.  Use of Standardized Patients in Clinical Assessments: Recent Developments and Measurement Findings , 1994 .

[15]  M. Philbin,et al.  Positive effects of a clinical performance assessment program , 1991, Academic medicine : journal of the Association of American Medical Colleges.

[16]  David L. Post,et al.  Medical Problem Solving: An Analysis of Clinical Reasoning , 1979 .

[17]  Rimoldi Hj,et al.  The test of diagnostic skills. , 1961 .

[18]  N. Frederiksen The real test bias: Influences of testing on teaching and learning. , 1984 .

[19]  Judy A. Shea,et al.  Strategies in Comparison of Methods for Scoring Patient Managementproblems , 1988 .

[20]  C. Woodward,et al.  Measuring physicians' performances by using simulated patients. , 1985, Journal of medical education.

[21]  D. H. Besterfield Quality control , 1979 .

[22]  G Bordage,et al.  Elaborated knowledge: a key to successful diagnostic thinking , 1994, Academic medicine : journal of the Association of American Medical Colleges.

[23]  W. Simon Oral examinations. , 1947, Northwest dentistry.

[24]  R. Shavelson,et al.  Research news and Comment: Performance Assessments , 1992 .

[25]  Stephen B. Dunbar,et al.  Quality Control in the Development and Use of Performance Assessments , 1991 .

[26]  Harold F. O'Neil,et al.  Policy and validity prospects for performance-based assessment. , 1993 .

[27]  R. Shavelson,et al.  Sampling Variability of Performance Assessments. , 1993 .

[28]  David B. Swanson,et al.  Assessment of Clinical Competence: Written and Computer-Based Simulations , 1987 .

[29]  N. Webb,et al.  Generalizability of Job Performance Measurements: Marine Corps Rifleman , 1990 .

[30]  G. Webster,et al.  A Comparison of Knowledge, Synthesis, and Clinical Judgment , 1984, Evaluation & the health professions.

[31]  S G Clyman,et al.  Using clinician ratings to model score weights for a computer‐based clinical‐simulation examination , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[32]  G. Norman,et al.  Pitfalls in the pursuit of objectivity: issues of reliability , 1991, Medical education.

[33]  G. Norman,et al.  Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability , 1991, Medical education.

[34]  S. Messick The Interplay of Evidence and Consequences in the Validation of Performance Assessments , 1994 .

[35]  G R LEYMASTER,et al.  Medical Education in the United States and Canada , 1910, Nature.

[36]  J. Frederiksen,et al.  A Systems Approach to Educational Testing , 1989 .

[37]  Geoffrey R. Norman,et al.  Assessing "clinical competence". , 1968, British medical journal.

[38]  H J RIMOLDI,et al.  The test of diagnostic skills. , 1961, Journal of medical education.

[39]  Lorrie A. Shepard,et al.  Will National Tests Improve Student Learning , 1991 .

[40]  Robert L. Linn,et al.  Educational Assessment: Expanded Expectations and Challenges , 1993 .