Assessing clinical reasoning in airway related cases among anesthesiology fellow residents using Script Concordance Test (SCT)

ABSTRACT Introduction Clinical reasoning is a core competency for physicians. In the field of anesthesia, many situations require residents to use their clinical reasoning to make quick and appropriate decisions such as during emergency airway cases. The Script Concordance Test (SCT) is a test developed in recent years and validated that objectively assess clinical reasoning ability. However, studies involving SCT to assess clinical reasoning in airway management is scarce. Aim To evaluate SCT in assessing clinical reasoning for airway management in anesthesiology residents. Method A cross-sectional study involving residents and anesthesiology consultants from the Department of Anesthesiology and Intensive Care, Faculty of Medicine Universitas Indonesia was conducted to complete SCT. A panel of five anesthesiology consultants with more than 15 years of work experience constructed 20 SCT vignettes based on prevalent airway cases in our center from the past 10 years. Each SCT has three nested questions, with a total of 60 questions, to be answered within 120 min. Results The SCT of 20 case vignettes with three nested questions were tested on 99 residents from the junior, intermediate, and senior residents, compared to answers from the expert group consisting of ten anesthesiology consultants with more than 5 years of experience. There were significant differences in mean SCT scores in the junior, intermediate, senior and expert groups, 59.3 (46.1–72.8), 64.7 (39.9–74.9), 67.5 (50.6–78.3), and 79.6 (78.4–84.8); p < 0,001 consecutively. Cronbach Alpha 0.69 was obtained, indicating good reliability. Conclusion Our SCT was proven to be a valid and reliable test instrument to assess the clinical reasoning in airway management for anesthesiology residents. SCT was able to discriminate between groups of different clinical experiences and should be included to evaluate airway competencies in anesthesiology residents.

[1]  D. Salmerón Martínez,et al.  Clinical reasoning evaluation using script concordance test in primary care residents. , 2022, Anales de pediatria.

[2]  E. Cowan,et al.  Assessment of Emergency Medicine Residents’ Clinical Reasoning: Validation of a Script Concordance Test , 2020, The western journal of emergency medicine.

[3]  J. Norcini,et al.  Assessing clinical reasoning skills using Script Concordance Test (SCT) and extended matching questions (EMQs): A pilot for urology trainees , 2019, Journal of advances in medical education & professionalism.

[4]  M. Wan,et al.  Improving the validity of script concordance testing by optimising and balancing items , 2018, Medical education.

[5]  S. Oustric,et al.  Reliability and validity of the script concordance test for postgraduate students of general practice , 2017, The European journal of general practice.

[6]  Andrew Teodorczuk,et al.  Teaching clinical reasoning to medical students. , 2017, British journal of hospital medicine.

[7]  T. Papadimos,et al.  High-fidelity anesthesia simulation in medical student education: Three fundamental and effective teaching scenarios , 2017 .

[8]  Tanya N. Beran,et al.  Development of a Method to Measure Clinical Reasoning in Pediatric Residents: The Pediatric Script Concordance Test , 2016 .

[9]  M. Amini,et al.  The validity and reliability of script concordance test in otolaryngology residency training , 2016, Journal of advances in medical education & professionalism.

[10]  M. Roberti,et al.  Script concordance test in medical schools in Brazil: possibilities and limitations , 2016, Sao Paulo medical journal = Revista paulista de medicina.

[11]  Anshu,et al.  Teaching and assessing clinical reasoning skills , 2015, Indian Pediatrics.

[12]  K. Asehnoune,et al.  The Script Concordance Test in anesthesiology: Validation of a new tool for assessing clinical reasoning. , 2015, Anaesthesia, critical care & pain medicine.

[13]  P. Drolet.  Assessing clinical reasoning in anesthesiology: Making the case for the Script Concordance Test. , 2015, Anaesthesia, critical care & pain medicine.

[14]  S. Mathieu,et al.  Construction and utilization of a script concordance test as an assessment tool for dcem3 (5th year) medical students in rheumatology , 2013, BMC medical education.

[15]  B. Charlin,et al.  The Practicum Script Concordance Test: An Online Continuing Professional Development Format to Foster Reflection on Clinical Practice , 2013, The Journal of continuing education in the health professions.

[16]  B. Charlin,et al.  Script concordance testing: From theory to practice: AMEE Guide No. 75 , 2013, Medical teacher.

[17]  M. Zamakhshary,et al.  Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education , 2012, BMC medical education.

[18]  B. Charlin,et al.  Assessment of Undergraduate Clinical Reasoning in Geriatric Medicine: Application of a Script Concordance Test , 2012, Journal of the American Geriatrics Society.

[19]  B. Charlin,et al.  How to construct and implement script concordance tests: insights from a systematic review , 2012, Medical education.

[20]  T. Nouh,et al.  The script concordance test as a measure of clinical reasoning: a national validation study. , 2012, American journal of surgery.

[21]  B. Charlin,et al.  Online script concordance test for clinical reasoning assessment in otorhinolaryngology: the association between performance and clinical experience. , 2011, Archives of otolaryngology--head & neck surgery.

[22]  Edward J. Miech,et al.  Assessing clinical reasoning skills in scenarios of uncertainty: convergent validity for a Script Concordance Test in an emergency medicine clerkship and residency. , 2011, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[23]  B. Charlin,et al.  The script concordance test in radiation oncology: validation study of a new tool to assess clinical reasoning , 2009, Radiation oncology.

[24]  Bernard Charlin,et al.  Script Concordance Tests: Guidelines for Construction , 2008, BMC Medical Informatics Decis. Mak..

[25]  S. Darmoni,et al.  On line clinical reasoning assessment with Script Concordance test in urology: results of a French pilot study , 2006, BMC medical education.

[26]  K. Goldmann,et al.  Education and training in airway management. , 2005, Best practice & research. Clinical anaesthesiology.

[27]  Stéfan Jacques Darmoni,et al.  Online clinical reasoning assessment with the Script Concordance test: a feasibility study , 2005, BMC Medical Informatics Decis. Mak..

[28]  B. Charlin,et al.  Assessment in the context of uncertainty: how many members are needed on the panel of reference of a script concordance test? , 2005, Medical education.

[29]  S. H. Wan,et al.  Using the script concordance test to assess clinical reasoning skills in undergraduate and postgraduate medicine. , 2015, Hong Kong medical journal = Xianggang yi xue za zhi.