The validity and reliability of script concordance test in otolaryngology residency training

Introduction The script concordance test (SCT) is one the best tools used to evaluate clinical reasoning in ill-defined clinical situations. The aim of this study was to demonstrate SCT application in otolaryngology residency training. Methods A 20 item otolaryngology SCT containing 60 questions was administered to 26 otolaryngology residents. The test was prepared by two otolaryngologists familiar to medical education. These questions have been validated by otolaryngology experts. The panel consisted of 9 academic staff in the field of otolaryngology. Pearson correlation test was used to assess the reliability of the test. Results The obtained mean scores were 68.4±5.8 (out of 100) for residents and 78.2±6.4(out of 100) for experts. There was a significant difference between the two scores (p<0.005). Cronbach’s alpha value was 0.80. Conclusion The SCT is a reliable tool to evaluate clinical reasoning in otolaryngology residents. It should be included in otolaryngology residency training.

[1]  S. Mathieu,et al.  Construction and utilization of a script concordance test as an assessment tool for dcem3 (5th year) medical students in rheumatology , 2013, BMC medical education.

[2]  Peyman Adibi,et al.  An innovative method to assess clinical reasoning skills: Clinical reasoning tests in the second national medical science Olympiad in Iran , 2011, BMC Research Notes.

[3]  M. Amini,et al.  TALENTS FOR FUTURE: REPORT OF THE SECOND NATIONAL MEDICAL SCIENCE OLYMPIAD IN ISLAMIC REPUBLIC OF IRAN , 2011 .

[4]  Edward J. Miech,et al.  Assessment of clinical reasoning: A Script Concordance test designed for pre-clinical medical students , 2011, Medical teacher.

[5]  Chu de Bordeaux,et al.  Utilisation du test de concordance de script au cours du deuxième cycle des études médicales : expérience dans l'enseignement de la neurochirurgie Use of script concordance tests among fourth- to sixth-year medical students: research in teaching neurosurgery , 2011 .

[6]  B. Charlin,et al.  The Reliability and Validity of a Paediatric Script Concordance Test with Medical Students, Paediatric Residents and Experienced Paediatricians , 2010 .

[7]  B. Charlin,et al.  The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning , 2009, Radiation oncology.

[8]  Bernard Charlin,et al.  Script Concordance Tests: Guidelines for Construction , 2008, BMC Medical Informatics Decis. Mak..

[9]  Bernard Charlin,et al.  Scripts and clinical reasoning , 2007, Medical education.

[10]  S. Darmoni,et al.  On line clinical reasoning assessment with Script Concordance test in urology: results of a French pilot study , 2006, BMC medical education.

[11]  C. Kreiter,et al.  The Psychometric Properties of Five Scoring Methods Applied to the Script Concordance Test , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[12]  B. Charlin,et al.  Assessment in the context of uncertainty: how many members are needed on the panel of reference of a script concordance test? , 2005, Medical education.

[13]  Bernard Charlin,et al.  Standardized Assessment of Reasoning in Contexts of Uncertainty , 2004, Evaluation & the health professions.

[14]  J. Moreau,et al.  Le test de concordance de script (TCS) comme outil d’évaluation formative des internes en neurochirurgie : implantation du test sur Internet à l’échelle nationale , 2004 .

[15]  C. V. D. van der Vleuten,et al.  The Script Concordance Test: A Tool to Assess the Reflective Clinician , 2000, Teaching and learning in medicine.