The objective structured clinical examination: a step in the direction of competency-based evaluation.

BACKGROUND The Accreditation Council for Graduate Medical Education is embarking on the major task of a paradigm shift in graduate education in the direction of competency-based medical education and evaluation of outcomes. The Objective Structured Clinical Examination (OSCE), a measure of clinical competence that focuses on outcomes via observable behaviors, is gaining national recognition. OBJECTIVE To review the pediatric literature relevant to the OSCE. METHOD A MEDLINE search from the date of the original report of the OSCE (1975) to the present was performed. All English-language studies regarding the use of the OSCE in pediatric education published in the United States and Great Britain were reviewed. MAIN OUTCOME MEASURES Reliability and validity of the OSCE were examined. Use of standardized pediatric patients was discussed. RESULTS A greater number of stations and similarity between tasks at different stations increased the reliability of the OSCE. A greater number of stations increased sampling of material and content validity. Correlation between the OSCE and precertification examinations ranged between 0.59 and 0.71, with P< or =.01. Correlation between the OSCE and monthly clinical evaluations was much lower (0.39-0.57), but still statistically significant at P< or =.05. Gaps between expected and actual performance were documented. Overall, the experience of being a standardized patient was viewed as positive by children and their parents. CONCLUSIONS With appropriate attention to design, acceptable reliability and validity can be achieved for the OSCE. Significant correlations between the OSCE and precertification examinations as well as monthly clinical evaluations were found, the former being stronger than the latter. We conclude that the combination of the OSCE, standardized board examinations, and direct observation in the clinical setting has the potential to become the "gold standard" for measuring physician competence.

[1]  B. Joorabchi.  Objective structured clinical examination in a pediatric residency program. , 1991, American journal of diseases of children.

[2]  S. Tallett,et al.  The use of an objective structured clinical examination with postgraduate residents in pediatrics. , 1998, Archives of pediatrics & adolescent medicine.

[3]  An objective undergraduate clinical examination in child health. , 1980, Archives of disease in childhood.

[4]  L. Perkowski,et al.  The relationship between preceptor expectations and student performance on 2 pediatric objective structured clinical examination stations. , 1998, Archives of pediatrics & adolescent medicine.

[5]  R. Reznick,et al.  Reliability and validity of the objective structured clinical examination in assessing surgical residents. , 1990, American journal of surgery.

[6]  J S Baumber,et al.  Guidelines for estimating the real cost of an objective structured clinical examination , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[7]  J. Colliver,et al.  Assessing clinical performance with standardized patients. , 1997, JAMA.

[8]  I. R. Hart,et al.  The effectiveness of immediate feedback during the Objective Structured Clinical Examination , 1989, Medical education.

[9]  M B Donnelly,et al.  Assessing residents' clinical performance: cumulative results of a four-year study with the Objective Structured Clinical Examination. , 1998, Surgery.

[10]  D. Lie,et al.  Use of an objective structured clinical examination in evaluating student performance. , 1998, Family medicine.

[11]  M B Donnelly,et al.  The Objective Structured Clinical Examination The New Gold Standard for Evaluating Postgraduate Clinical Performance , 1995, Annals of surgery.

[12]  D. Solomon,et al.  Setting standards and defining quality of performance in the validation of a standardized‐patient examination format , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[13]  D. Price,et al.  Objective structured clinical examination compared with other forms of student assessment. , 1984, Archives of disease in childhood.

[14]  D. Witzke,et al.  Sharing of information by students in an objective structured clinical examination. , 1991, Archives of internal medicine.

[15]  A Ziv,et al.  A pediatric clinical skills assessment using children as standardized patients. , 1999, Archives of pediatrics & adolescent medicine.

[16]  A. Watson,et al.  Evaluation of an objective structured clinical examination. , 1982, Archives of disease in childhood.

[17]  D. Matsell,et al.  Reliability and validity of the objective structured clinical examination in paediatrics , 1991, Medical education.

[18]  S. Hodder,et al.  Validity of three clinical performance assessments of internal medicine clerks , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[19]  M B Donnelly,et al.  The Use of the Objective Structured Clinical Examination (OSCE) for Evaluation and Instruction in Graduate Medical Education , 1996 .

[20]  J. DeVries,et al.  Evaluation of clinical competence: the gap between expectation and performance. , 1996, Pediatrics.

[21]  C. Woodward,et al.  Children as standardized patients: Initial assessment of effects , 1995 .

[22]  E. Petrusa,et al.  Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents. , 1990, Archives of internal medicine.

[23]  R. Harden,et al.  Assessment of clinical competence using objective structured examination. , 1975, British medical journal.

[24]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[25]  P. Joseph.  Henoch-Schönlein purpura. , 1998, Archives of pediatrics & adolescent medicine.

[26]  R. Reznick,et al.  A comparative analysis of the costs of administration of an OSCE (objective structured clinical examination) , 1994, Academic medicine : journal of the Association of American Medical Colleges.