Bmc Medical Informatics and Decision Making Script Concordance Tests: Guidelines for Construction

BackgroundSCT is used to assess clinical reasoning in ambiguous or uncertain situations. It allows testing on real-life situations that are not adequately measured with current tests. It probes the multiple judgments that are made in the clinical reasoning process. Scoring reflects the degree of concordance of these judgments to those of a panel of reference experts.MethodSCT is an item format that is gaining acceptance in education in the health professions. However, there are no detailed guidelines on item writing, test scoring or test optimization.ResultsThe item format is described and the steps for preparing and administering reliable and valid SCTs are presented.ConclusionSCTs probe examinees on a specific clinical reasoning task: data interpretation, a crucial step in the clinical reasoning process. It is inferred that a high degree of concordance corresponds to optimal use of information in the context of these specific tasks and therefore provides an indication of clinical reasoning quality.

[1]  C. V. D. van der Vleuten,et al.  The Script Concordance Test: A Tool to Assess the Reflective Clinician , 2000, Teaching and learning in medicine.

[2]  Zubair Amin,et al.  Practical Guide To Medical Student Assessment , 2006 .

[3]  B. Charlin,et al.  Assessment in the context of uncertainty: how many members are needed on the panel of reference of a script concordance test? , 2005, Medical education.

[4]  H. Schmidt,et al.  A cognitive perspective on medical expertise: theory and implication [published erratum appears in Acad Med 1992 Apr;67(4):287] , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[5]  R. Petrella,et al.  Improving management of musculoskeletal disorders in primary care: the Joint Adventures Program , 2007, Clinical Rheumatology.

[6]  B. Charlin,et al.  Script concordance testing: more cases or more questions? , 2009, Advances in health sciences education : theory and practice.

[7]  B. Charlin,et al.  Is the script concordance test a valid instrument for assessment of intraoperative decision-making skills? , 2007, American journal of surgery.

[8]  Bernard Charlin,et al.  Scripts and clinical reasoning , 2007, Medical education.

[9]  L. Jacoby,et al.  Knowledge and clinical problem‐solving , 1985, Medical education.

[10]  C. Kreiter,et al.  The Psychometric Properties of Five Scoring Methods Applied to the Script Concordance Test , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[11]  K. Hall.  Reviewing intuitive decision‐making and uncertainty: the implications for medical education , 2002, Medical education.

[12]  J. Fournier,et al.  Évaluation du raisonnement clinique en médecine d'urgence : les tests de concordance des scripts décèlent mieux l'expérience clinique que les questions à choix multiples à contexte riche , 2006 .

[13]  C. V. D. van der Vleuten,et al.  The Cognitive Validity of the Script Concordance Test: A Processing Time Study , 2006, Teaching and learning in medicine.

[14]  L. Crocker,et al.  Introduction to Classical and Modern Test Theory , 1986 .

[15]  Bernard Charlin,et al.  Standardized Assessment of Reasoning in Contexts of Uncertainty , 2004, Evaluation & the health professions.

[16]  Bernard Charlin,et al.  Assessment of clinical reasoning in the context of uncertainty: the effect of variability within the reference panel , 2006, Medical education.

[17]  G Bordage,et al.  The Medical Council of Canada's key features project: a more valid written examination of clinical decision‐making skills , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[18]  Michele Groves,et al.  Clinical reasoning: the relative contribution of identification, interpretation and hypothesis errors to misdiagnosis , 2003, Medical teacher.

[19]  J. Moreau,et al.  Auto-évaluation des internes en neurochirurgie par tests de concordance de script (TCS) , 2004 .

[20]  G. Norman,et al.  How specific is case specificity? , 2006, Medical education.

[21]  A. Furber,et al.  Appropriateness of Diagnostic Management and Outcomes of Suspected Pulmonary Embolism , 2006, Annals of Internal Medicine.

[22]  Robert F. DeVellis,et al.  Uncertainty and Professional Work: Perceptions of Physicians in Clinical Practice , 1992, American Journal of Sociology.