Simulation-based bronchoscopy training: systematic review and meta-analysis.

BACKGROUND Simulation-based bronchoscopy training is increasingly used, but effectiveness remains uncertain. We sought to perform a comprehensive synthesis of published work on simulation-based bronchoscopy training. METHODS We searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, Web of Science, and Scopus for eligible articles through May 11, 2011. We included all original studies involving health professionals that evaluated, in comparison with no intervention or an alternative instructional approach, simulation-based training for flexible or rigid bronchoscopy. Study selection and data abstraction were performed independently and in duplicate. We pooled results using random effects meta-analysis. RESULTS From an initial pool of 10,903 articles, we identified 17 studies evaluating simulation-based bronchoscopy training. In comparison with no intervention, simulation training was associated with large benefits on skills and behaviors (pooled effect size, 1.21 [95% CI, 0.82-1.60]; n=8 studies) and moderate benefits on time (0.62 [95% CI, 0.12-1.13]; n=7). In comparison with clinical instruction, behaviors with real patients showed nonsignificant effects favoring simulation for time (0.61 [95% CI, -1.47 to 2.69]) and process (0.33 [95% CI, -1.46 to 2.11]) outcomes (n=2 studies each), although variation in training time might account for these differences. Four studies compared alternate simulation-based training approaches. Inductive analysis to inform instructional design suggested that longer or more structured training is more effective, authentic clinical context adds value, and animal models and plastic part-task models may be superior to more costly virtual-reality simulators. CONCLUSIONS Simulation-based bronchoscopy training is effective in comparison with no intervention. Comparative effectiveness studies are few.

[1]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[3]  M. H. Dykes,et al.  Learning fibreoptic intubation: use of simulators v. traditional teaching. , 1988, British journal of anaesthesia.

[4]  Donald L. Kirkpatrick,et al.  Great Ideas Revisited. Techniques for Evaluating Training Programs. Revisiting Kirkpatrick's Four-Level Model. , 1996 .

[5]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[6]  P. Kvale,et al.  Bronchoscopy training: current fellows' experiences and some concerns for the future. , 2000, Chest.

[7]  H. Colt,et al.  Virtual reality bronchoscopy simulation: a revolution in procedural training. , 2001, Chest.

[8]  A. Mehta,et al.  Assessment of a bronchoscopy simulator. , 2001, American journal of respiratory and critical care medicine.

[9]  P. White,et al.  Bronchoscopy training: is simulated surgery effective? , 2002, Clinical otolaryngology and allied sciences.

[10]  [Learning bronchoscopy in simulator improved dexterity rather than judgement]. , 2003, Lakartidningen.

[11]  門倉 光隆,et al.  Colt HG, Crawford SW, Galbraith O., Virtual reality bronchoscopy simulation : a revolution in procedual training., Chest., 2001, 120, 1333-1339 , 2003 .

[12]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[13]  A. Ziv,et al.  Simulation-based medical education: an ethical imperative. , 2006, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[14]  Pernilla Hallberg,et al.  Att lära bronkoskopi i simulator gav mer fingerfärdighet än omdöme , 2003 .

[15]  K. Moorthy,et al.  Evaluation of Virtual Reality Bronchoscopy as a Learning and Assessment Tool , 2003, Respiration.

[16]  M. Blum,et al.  Bronchoscopy simulator effectively prepares junior residents to competently perform basic clinical bronchoscopy. , 2004, The Annals of thoracic surgery.

[17]  P. Larsen,et al.  Effective Nonanatomical Endoscopy Training Produces Clinical Airway Endoscopy Proficiency , 2004, Anesthesia and analgesia.

[18]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[19]  The Dexter® Endoscopic Dexterity Trainer improves fibreoptic bronchoscopy skills: Preliminary observations , 2005, Canadian journal of anaesthesia = Journal canadien d'anesthesie.

[20]  N. Pastis,et al.  Variation in training for interventional pulmonary procedures among US pulmonary/critical care fellowships: a survey of fellowship directors. , 2005, Chest.

[21]  J. Feinglass,et al.  Mastery learning of advanced cardiac life support skills by internal medicine residents using simulation technology and deliberate practice , 2006, Journal of General Internal Medicine.

[22]  Yi-Ping Hung,et al.  Validation of a computer-based bronchoscopy simulator developed in Taiwan. , 2006, Journal of the Formosan Medical Association = Taiwan yi zhi.

[23]  David A Cook,et al.  Association between funding and quality of published medical education research. , 2007, JAMA.

[24]  H. Schmidt,et al.  Description, justification and clarification: a framework for classifying the purposes of research in medical education , 2008, Medical education.

[25]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[26]  Kathryn Osann,et al.  Validation of Two Instruments to Assess Technical Bronchoscopic Skill Using Virtual Reality Simulation , 2008, Respiration.

[27]  Liang Shen,et al.  Experiential learning improves the learning and retention of endotracheal intubation , 2009, Medical education.

[28]  Paul E. Mazmanian,et al.  Lessons for continuing medical education from simulation research in undergraduate and graduate medical education: effectiveness of continuing medical education: American College of Chest Physicians Evidence-Based Educational Guidelines. , 2009, Chest.

[29]  E. Deutsch,et al.  Multimodality Education for Airway Endoscopy Skill Development , 2009, The Annals of otology, rhinology, and laryngology.

[30]  H. Colt,et al.  Bronchoscopy simulation: a brief review , 2008, Advances in health sciences education : theory and practice.

[31]  A. Pereira,et al.  Competency-Based Education and Training in Internal Medicine , 2010, Annals of Internal Medicine.

[32]  S. Murgu,et al.  Measuring learning gain during a one-day introductory bronchoscopy course , 2010, Surgical Endoscopy.

[33]  Kevin J Anstrom,et al.  A prospective multicenter study of competency metrics and educational interventions in the learning of bronchoscopy among new pulmonary fellows. , 2010, Chest.

[34]  Preparation of a fiberoptic bronchoscopy training box and evaluation of its efficacy: Preparation of a fiberoptic bronchoscopy training box and evaluation of its efficacy , 2010 .

[35]  M. Wahidi,et al.  Comparative Effectiveness of Low- and High-Fidelity Bronchoscopy Simulation for Training in Conventional Transbronchial Needle Aspiration and User Preferences , 2010, Respiration.

[36]  David A Cook,et al.  Simulation-based objective assessment discerns clinical proficiency in central line placement: a construct validation. , 2010, Chest.

[37]  D. Cook,et al.  Computerized Virtual Patients in Health Professions Education: A Systematic Review and Meta-Analysis , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[38]  D. Cook,et al.  Instructional Design Variations in Internet-Based Learning for Health Professions Education: A Systematic Review and Meta-Analysis , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[39]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[40]  M. Zhang,et al.  Microneedle technique in promoting transdermal delivery of arbutin: Microneedle technique in promoting transdermal delivery of arbutin , 2011 .

[41]  A. Tremblay,et al.  Simulation in Flexible Bronchoscopy and Endobronchial Ultrasound: A Review , 2011, Journal of bronchology & interventional pulmonology.

[42]  R. Sauve,et al.  Use of Simulation-Based Education to Improve Outcomes of Central Venous Catheterization: A Systematic Review and Meta-Analysis , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[43]  R. Sweet,et al.  Psychomotor Skills Training in Pediatric Airway Endoscopy Simulation , 2011, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[44]  J. Barsuk,et al.  Does Simulation-Based Medical Education With Deliberate Practice Yield Better Results Than Traditional Clinical Education? A Meta-Analytic Comparative Review of the Evidence , 2011, Academic medicine : journal of the Association of American Medical Colleges.

[45]  A. Tremblay,et al.  Assessment and learning curve evaluation of endobronchial ultrasound skills following simulation and clinical training , 2011, Respirology.

[46]  A. Tremblay,et al.  Evaluation of clinical endobronchial ultrasound skills following clinical versus simulation training , 2011, Respirology (Carlton South. Print).

[47]  M. Roizen,et al.  Technology-enhanced simulation for health professions education: a systematic review and meta-analysis , 2012 .

[48]  S. Hamstra,et al.  Mastery Learning for Health Professionals Using Technology-Enhanced Simulation: A Systematic Review and Meta-Analysis , 2013, Academic medicine : journal of the Association of American Medical Colleges.