Techniques for measuring clinical competence: objective structured clinical examinations

The traditional clinical examination has been shown to have serious limitations in terms of its validity and reliability. The OSCE provides some answers to these limitations and has become very popular. Many variants on the original OSCE format now exist and much research has been done on various aspects of their use. Issues to be addressed relate to organization matters and to the quality of the assessment. This paper focuses particularly on the latter with respect to ways of ensuring content validity and achieving acceptable levels of reliability. A particular concern has been the demonstrable need for long examinations if high levels of reliability are to be achieved. Strategies for reducing the practical difficulties this raises are discussed. Standard setting methods for use with OSCEs are described.

[1]  J. Spencer,et al.  The metric of medical education , 2002, Medical education.

[2]  R. Harden,et al.  Assessment of clinical competence using an objective structured clinical examination (OSCE). , 1979, Medical education.

[3]  Diana H. J. M. Dolmans,et al.  International handbook of research in medical education , 2002 .

[4]  H. A. Carithers.  Measuring Medical Education. , 1972 .

[5]  Prospects Liubolong.  Improving quality. , 1990, The Psychiatric clinics of North America.

[6]  D. Newble,et al.  Psychometric characteristics of the objective structured clinical examination , 1988, Medical education.

[7]  Geoffrey R. Norman,et al.  Performance-Based Assessment: Lessons From the Health Professions , 1995 .

[8]  M. Cusimano.  Standard setting in medical education , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[9]  E. Petrusa.  Clinical Performance Assessments , 2002 .

[10]  R. Reznick,et al.  An objective structured clinical examination for the licentiate of the Medical Council of Canada: from research to reality , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[11]  John Bennison,et al.  Association for the Study of Medical Education , 1967 .

[12]  D. Blackmore,et al.  Setting standards for an objective structured clinical examination: the borderline group method gains ground on Angoff. , 2001 .

[13]  R. Reznick,et al.  Comparing the psychometric properties of checklists and global rating scales for assessing performance on an OSCE‐format examination , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[14]  C. V. D. van der Vleuten,et al.  Composite undergraduate clinical examinations: how should the components be combined to maximize reliability? , 2001, Medical education.

[15]  D M Kaufman,et al.  A Comparison of Standard‐setting Procedures for an OSCE in Undergraduate Medical Education , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[16]  R. Fox,et al.  Defining the content for the objective structured clinical examination component of the Professional and Linguistic Assessments Board examination: development of a blueprint , 2000, Medical education.

[17]  J. Norcini,et al.  Setting standards on educational tests , 2003, Medical education.

[18]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[19]  R. Reznick,et al.  An objective structured clinical examination for the licentiate: report of the pilot project of the Medical Council of Canada , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[20]  Brian Jolly,et al.  Assessing health professionals , 2002, Medical education.

[21]  R. Tamblyn,et al.  The accuracy of standardized patient presentation , 1991, Medical education.

[22]  C. V. D. Vleuten,et al.  The assessment of professional competence: Developments, research and practical implications , 1996 .

[23]  D. Newble,et al.  Standard setting in an objective structured clinical examination: use of global ratings of borderline performance to determine the passing score , 2001, Medical education.

[24]  R. Reznick,et al.  The use of global ratings in OSCE station scores , 1996, Advances in health sciences education : theory and practice.

[25]  David B. Swanson,et al.  Assessment of clinical skills with standardized patients: State of the art , 1990 .

[26]  C. V. D. van der Vleuten.  Validity of final examinations in undergraduate medical training , 2000, BMJ : British Medical Journal.

[27]  A. Scherpbier,et al.  The effect on reliability of adding a separate written assessment component to an objective structured clinical examination , 2000, Medical education.

[28]  D. Newble,et al.  Assessing clinical competence at the undergraduate level. , 1992, Medical education.

[29]  C. V. D. van der Vleuten,et al.  The assessment of professional competence: Developments, research and practical implications. , 1996, Advances in health sciences education : theory and practice.

[30]  Association for the Study of Medical Education , 1970 .

[31]  D. Blackmore,et al.  Setting standards for an objective structured clinical examination: the borderline group method gains ground on Angoff , 2001, Medical education.