Reporting guidelines for health care simulation research: extensions to the CONSORT and STROBE statements

BackgroundSimulation-based research (SBR) is rapidly expanding but the quality of reporting needs improvement. For a reader to critically assess a study, the elements of the study need to be clearly reported. Our objective was to develop reporting guidelines for SBR by creating extensions to the Consolidated Standards of Reporting Trials (CONSORT) and Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statements.MethodsAn iterative multistep consensus-building process was used on the basis of the recommended steps for developing reporting guidelines. The consensus process involved the following: (1) developing a steering committee, (2) defining the scope of the reporting guidelines, (3) identifying a consensus panel, (4) generating a list of items for discussion via online premeeting survey, (5) conducting a consensus meeting, and (6) drafting reporting guidelines with an explanation and elaboration document.ResultsThe following 11 extensions were recommended for CONSORT: item 1 (title/abstract), item 2 (background), item 5 (interventions), item 6 (outcomes), item 11 (blinding), item 12 (statistical methods), item 15 (baseline data), item 17 (outcomes/ estimation), item 20 (limitations), item 21 (generalizability), and item 25 (funding). The following 10 extensions were recommended for STROBE: item 1 (title/abstract), item 2 (background/rationale), item 7 (variables), item 8 (data sources/measurement), item 12 (statistical methods), item 14 (descriptive data), item 16 (main results), item 19 (limitations), item 21 (generalizability), and item 22 (funding). An elaboration document was created to provide examples and explanation for each extension.ConclusionsWe have developed extensions for the CONSORT and STROBE Statements that can help improve the quality of reporting for SBR (Sim Healthcare 00:00-00, 2016).

[1]  W. McGaghie,et al.  A critical review of simulation‐based medical education research: 2003–2009 , 2010, Medical education.

[2]  John McLeod.  Advances in Simulation , 1968, Adv. Comput..

[3]  M. Auerbach,et al.  Neonatal intubation performance: room for improvement in tertiary neonatal intensive care units. , 2013, Resuscitation.

[4]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2007, Preventive medicine.

[5]  D. Cook,et al.  Technology-enhanced simulation in emergency medicine: a systematic review and meta-analysis. , 2013, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[6]  Linda L. Brown,et al.  Perception of CPR quality: Influence of CPR feedback, Just-in-Time CPR training and provider role. , 2015, Resuscitation.

[7]  M. Auerbach,et al.  Using simulation to improve patient safety: dawn of a new era. , 2015, JAMA pediatrics.

[8]  Douglas G Altman,et al.  Reporting of noninferiority and equivalence randomized trials: an extension of the CONSORT statement. , 2006, JAMA.

[9]  David A Cook,et al.  Technology-Enhanced Simulation to Assess Health Professionals: A Systematic Review of Validity Evidence, Research Methods, and Reporting Quality , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Ryan Brydges,et al.  Patient Outcomes in Simulation-Based Medical Education: A Systematic Review , 2013, Journal of General Internal Medicine.

[11]  David A Cook,et al.  Quality of reporting of experimental studies in medical education: a systematic review , 2007, Medical education.

[12]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[13]  Jonathan Sherbino,et al.  Debriefing for technology‐enhanced simulation: a systematic review and meta‐analysis , 2014, Medical education.

[14]  D. Moher,et al.  Guidance for Developers of Health Research Reporting Guidelines , 2010, PLoS medicine.

[15]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. , 2003, Clinical chemistry.

[16]  V. Nadkarni,et al.  Research Regarding Debriefing as Part of the Learning Process , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[17]  Tara R. Lang,et al.  Technology-Enhanced Simulation and Pediatric Education: A Meta-analysis , 2014, Pediatrics.

[18]  Daniel M. Fein,et al.  Script Concordance Testing: Assessing Residents’ Clinical Decision-Making Skills for Infant Lumbar Punctures , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[19]  lhealtlhy youin-g,et al.  Hospital for Sick Children , 1857, British medical journal.

[20]  David Moher,et al.  Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. , 2008, Annals of internal medicine.

[21]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[22]  Jason H. Szostek,et al.  Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis , 2013, Medical teacher.

[23]  V. Nadkarni,et al.  Reporting Guidelines for Health Care Simulation Research: Extensions to the CONSORT and STROBE Statements , 2016, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[24]  Yiqun Lin,et al.  The use of high-fidelity manikins for advanced life support training--A systematic review and meta-analysis. , 2015, Resuscitation.

[25]  V. Nadkarni,et al.  Designing and Conducting Simulation-Based Research , 2014, Pediatrics.

[26]  Richard J. Anderson.  At the University of Arkansas , 1980 .

[27]  D. Altman,et al.  Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial , 2011, BMJ : British Medical Journal.

[28]  David A Cook,et al.  A systematic review of titles and abstracts of experimental studies in medical education: many informative elements missing. , 2007, Medical education.

[29]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials , 2001, The Lancet.

[30]  S. Pocock,et al.  Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. , 2006, JAMA.

[31]  D. Altman,et al.  CONSORT statement: extension to cluster randomised trials , 2004, BMJ : British Medical Journal.

[32]  Pamela A. Moss,et al.  Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association , 2006 .

[33]  M. Roizen,et al.  Technology-enhanced simulation for health professions education: a systematic review and meta-analysis , 2012 .

[34]  Daniel M. Fein,et al.  Interns' Success With Clinical Procedures in Infants After Simulation Training , 2013, Pediatrics.

[35]  V. Nadkarni,et al.  Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial. , 2013, JAMA pediatrics.

[36]  D. Cook,et al.  Simulation-based training in anaesthesiology: a systematic review and meta-analysis. , 2014, British journal of anaesthesia.

[37]  W. Tierney,et al.  Hate Speech and Academic Freedom in the Academy , 2006 .

[38]  J. Ioannidis,et al.  STrengthening the REporting of Genetic Association Studies (STREGA)— An Extension of the STROBE Statement , 2009, Annals of Internal Medicine.

[39]  Trish Groves,et al.  Enhancing the quality and transparency of health research , 2008, BMJ : British Medical Journal.

[40]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[41]  J. Earle,et al.  Common Guidelines for Education Research and Development , 2013 .

[42]  Douglas G Altman,et al.  Systematic reviews in health care: Assessing the quality of controlled clinical trials. , 2001, BMJ.

[43]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement , 2015, Systematic Reviews.

[44]  Greg Ogrinc,et al.  Publication guidelines for improvement studies in health care: evolution of the SQUIRE Project. , 2008, Annals of internal medicine.

[45]  Linda L. Brown,et al.  Improving cardiopulmonary resuscitation with a CPR feedback device and refresher simulations (CPR CARES Study): a randomized clinical trial. , 2015, JAMA pediatrics.

[46]  C. Dilaveri,et al.  Simulation training for breast and pelvic physical examination: a systematic review and meta‐analysis , 2013, BJOG : an international journal of obstetrics and gynaecology.

[47]  A. Walker,et al.  Improving the quality of reporting in randomised controlled trials. , 2004, Journal of wound care.

[48]  David A Cook,et al.  Linking Simulation-Based Educational Assessments and Patient-Related Outcomes: A Systematic Review and Meta-Analysis , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[49]  D. Moher,et al.  The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. , 2001, Journal of the American Podiatric Medical Association.

[50]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[51]  Tanja Manser,et al.  The Study of Factors Affecting Human and Systems Performance in Healthcare Using Simulation , 2011, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[52]  Sarah Garside,et al.  Method and reporting quality in health professions education research: a systematic review , 2011, Medical education.

[53]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. , 2004, Family practice.

[54]  J. Ioannidis,et al.  Reproducibility in Science: Improving the Standard for Basic and Preclinical Research , 2015, Circulation research.

[55]  G. Smith,et al.  Meta-analysis Spurious precision? Meta-analysis of observational studies , 1998, BMJ.

[56]  A. Ziv,et al.  Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review , 2005, Medical teacher.

[57]  James M. Gerard,et al.  Validation of Global Rating Scale and Checklist Instruments for the Infant Lumbar Puncture Procedure , 2013, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[58]  David A Cook,et al.  State of the Evidence on Simulation-Based Training for Laparoscopic Surgery: A Systematic Review , 2013, Annals of surgery.

[59]  Travis Whitfill,et al.  Impact of Just-in-Time and Just-in-Place Simulation on Intern Success With Infant Lumbar Puncture , 2015, Pediatrics.

[60]  David Moher,et al.  Reducing waste from incomplete or unusable reports of biomedical research , 2014, The Lancet.

[61]  S. Pocock,et al.  Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration , 2007, PLoS medicine.

[62]  R. Golub,et al.  Researchers, readers, and reporting guidelines: writing between the lines. , 2015, JAMA.

[63]  William C McGaghie,et al.  Translational educational research: a necessity for effective health-care improvement. , 2012, Chest.

[64]  B. Schneider,et al.  Standards for Reporting on Empirical Social Science Research in AERA Publications American Educational Research Association , 2006 .

[65]  D. Moher,et al.  Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond , 2004, Canadian Medical Association Journal.

[66]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[67]  P. Sainsbury,et al.  Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[68]  David A Cook,et al.  How much evidence does it take? A cumulative meta‐analysis of outcomes of simulation‐based education , 2014, Medical education.

[69]  Joshua Lederberg,et al.  Children's Hospital of Philadelphia. , 1975, The Australasian nurses journal.

[70]  D. Moher,et al.  Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review , 2006, The Medical journal of Australia.

[71]  D. Rennie,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative , 2003, BMJ : British Medical Journal.

[72]  T. Hansen.  [Children's hospital of Pittsburgh]. , 1995, Tidsskrift for den Norske laegeforening : tidsskrift for praktisk medicin, ny raekke.