Bi-cultural, bi-national benchmarking and assessment of clinical reasoning in Obstetrics and Gynaecology

Background: The Script Concordance Test (SCT) is being increasingly used in professional development in clinical reasoning (CR) in postgraduate medicine. On-line delivery favours multi-institutional collaboration. Objectives: To establish if: 1) SCT questions developed in the French-speaking University of Montreal were readily adaptable for use in the English-speaking University of Adelaide 2) expert reference panels (ERP) from both institutions could be used interchangeably 3) student cohorts would perform similarly in the same test. Study Design: 82 SCT questions based on 27 clinical cases in Obstetrics and Gynaecology were developed in Montreal and run in a volunteer cohort of year 3 and year 4 medical students (n=154). Local faculty translated all questions, selecting 31 based on 17 clinical cases for use in summative examinations a year 5 student cohort in Adelaide (n=123). Results: Mean (SD) percentage scores using each ERP key were: 74.2 (6.4) versus 73.3 (6.9), p<0.001 for Adelaide students and 72.5 (7.8) versus 70.6 (8.8), p<0.001 for Montreal students. The correlation coefficients were ≥ 0.928 (p<0.001).

[1]  S. Lotfipour,et al.  Challenging script concordance test reference standard by evidence: do judgments by emergency medicine consultants agree with likelihood ratios? , 2014, International Journal of Emergency Medicine.

[2]  B. Charlin,et al.  The Practicum Script Concordance Test: An Online Continuing Professional Development Format to Foster Reflection on Clinical Practice , 2013, The Journal of continuing education in the health professions.

[3]  Peter J Pronovost,et al.  25-Year summary of US malpractice claims for diagnostic errors 1986–2010: an analysis from the National Practitioner Data Bank , 2013, BMJ quality & safety.

[4]  B. Charlin,et al.  Script concordance testing: From theory to practice: AMEE Guide No. 75 , 2013, Medical teacher.

[5]  B. Charlin,et al.  Summative assessment of 5th year medical students’ clinical reasoning by script concordance test: requirements and challenges , 2012, BMC medical education.

[6]  Bernard Charlin,et al.  Script concordance testing: a review of published validity evidence , 2011, Medical education.

[7]  B. Charlin,et al.  The relationship between script concordance test scores in an obste rics-gynecology rotation and global performance assessments in the curriculum , 2011, International Journal of Medical Education.

[8]  J. Jelovsek,et al.  Assessment of intraoperative judgment during gynecologic surgery using the Script Concordance Test. , 2010, American journal of obstetrics and gynecology.

[9]  S. Brédart,et al.  Reasoning versus knowledge retention and ascertainment throughout a problem‐based learning curriculum , 2009, Medical education.

[10]  C. Chalk,et al.  The Script Concordance Test: A New Tool Assessing Clinical Judgement in Neurology , 2009, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[11]  B. Charlin,et al.  The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning , 2009, Radiation oncology.

[12]  P. Duggan.  Development of a Script Concordance Test using an Electronic Voting System. , 2007 .

[13]  S. Meterissian.  A Novel Method of Assessing Clinical Reasoning in Surgical Residents , 2006, Surgical innovation.

[14]  T. Roberts,et al.  Standard Setting for Clinical Competence at Graduation from Medical School: A Comparison of Passing Scores Across Five Medical Schools , 2006, Advances in health sciences education : theory and practice.

[15]  B. Charlin,et al.  Assessment in the context of uncertainty: how many members are needed on the panel of reference of a script concordance test? , 2005, Medical education.

[16]  Bernard Charlin,et al.  Measurement of perception and interpretation skills during radiology training: utility of the script concordance approach , 2004, Medical teacher.

[17]  C. V. D. van der Vleuten,et al.  Measurement of clinical reflective capacity early in training as a predictor of clinical reasoning performance at the end of residency: an experimental study on the script concordance test , 2001, Medical education.

[18]  C. V. D. van der Vleuten,et al.  The Script Concordance Test: A Tool to Assess the Reflective Clinician , 2000, Teaching and learning in medicine.

[19]  H P Boshuizen,et al.  Scripts and Medical Diagnostic Knowledge: Theory and Applications for Clinical Reasoning Instruction and Research , 2000, Academic medicine : journal of the Association of American Medical Colleges.