Critical appraisal of emergency medicine education research: the best publications of 2012.

OBJECTIVES The objective was to critically appraise and highlight medical education research published in 2012 that was methodologically superior and whose outcomes were pertinent to teaching and education in emergency medicine (EM). METHODS A search of the English language literature in 2012 querying Education Resources Information Center (ERIC), PsychInfo, PubMed, and Scopus identified EM studies using hypothesis-testing or observational investigations of educational interventions. Two reviewers independently screened all of the publications and removed articles using established exclusion criteria. This year, publications limited to a single-site survey design that measured satisfaction or self-assessment on unvalidated instruments were not formally reviewed. Six reviewers then independently ranked all remaining publications using one of two scoring systems depending on whether the study methodology was primarily qualitative or quantitative. Each scoring system had nine criteria, including four related to methodology, that were chosen a priori, to standardize evaluation by reviewers. The quantitative study scoring system was used previously to appraise medical education published annually in 2008 through 2011, while a separate, new qualitative study scoring system was derived and implemented consisting of parallel metrics. RESULTS Forty-eight medical education research papers met the a priori criteria for inclusion, and 33 (30 quantitative and three qualitative studies) were reviewed. Seven quantitative and two qualitative studies met the criteria for inclusion as exemplary and are summarized in this article. CONCLUSIONS This critical appraisal series aims to promote superior education research by reviewing and highlighting nine of the 48 major education research studies with relevance to EM published in 2012. Current trends and common methodologic pitfalls in the 2012 papers are noted.

[1]  Jonathan Fisher,et al.  Critical appraisal of emergency medicine educational research: the best publications of 2011. , 2014, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[2]  B. Horne,et al.  Emergency Medicine resident anesthesia training in a private vs. academic setting. , 2013, Journal of Emergency Medicine.

[3]  J. Greenslade,et al.  Intern underperformance is detected more frequently in emergency medicine rotations , 2013, Emergency medicine Australasia : EMA.

[4]  C. Marco,et al.  Competence and challenges of emergency medicine training as reported by emergency medicine residents. , 2012, The Journal of emergency medicine.

[5]  E. Jauch,et al.  Does Targeted Education of Emergency Physicians Improve Their Comfort Level in Treating Psychiatric Patients? , 2012, The western journal of emergency medicine.

[6]  L. Yarris,et al.  Executive summary: Education research in emergency medicine-opportunities, challenges, and strategies for success. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  J. Torres-Macho,et al.  Initial accuracy of bedside ultrasound performed by emergency physicians for multiple indications after a short training period. , 2012, The American journal of emergency medicine.

[8]  A. Takhar,et al.  The Simulation Olympics: a resuscitation-based simulation competition as an educational intervention. , 2012, CJEM.

[9]  P. Austin,et al.  Does ED crowding decrease the number of procedures a physician in training performs? A prospective observational study. , 2012, The American journal of emergency medicine.

[10]  Christopher M. Hicks,et al.  Crisis Resources for Emergency Workers (CREW II): results of a pilot study and simulation-based crisis resource management course for emergency medicine residents. , 2012, CJEM.

[11]  D. Ander,et al.  Reporter-Interpreter-Manager-Educator (RIME) descriptive ratings as an evaluation tool in an emergency medicine clerkship. , 2012, The Journal of emergency medicine.

[12]  H. Cameron,et al.  The distracted intravenous access (DIVA) test , 2012, The Clinical Teacher.

[13]  Sarah R. Williams,et al.  Use of cadaver models in point-of-care emergency ultrasound education for diagnostic applications. , 2012, The Journal of emergency medicine.

[14]  F. Ankel,et al.  A prospective, randomized, controlled study demonstrating a novel, effective model of transfer of care between physicians: the 5 Cs of consultation. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[15]  N. Kman,et al.  The Impact of Two Clinical Shift Allocation Models on Student Experiences in an Emergency Medicine Clerkship , 2012, Teaching and learning in medicine.

[16]  T. Strout,et al.  Implementation of transvaginal ultrasound in an emergency department residency program: an analysis of resident interpretation. , 2012, The Journal of emergency medicine.

[17]  Hao Wang,et al.  Dedicated emergency department ultrasound rotation improves residents' ultrasound knowledge and interpretation skills. , 2012, The Journal of emergency medicine.

[18]  J. Takayesu,et al.  A two-year experience of an integrated simulation residency curriculum. , 2012, The Journal of emergency medicine.

[19]  F. Bello,et al.  Simulating various levels of clinical challenge in the assessment of clinical procedure competence. , 2012, Annals of emergency medicine.

[20]  M. Pusic,et al.  Evaluating Cost Awareness Education in US Pediatric Emergency Medicine Fellowships , 2012, Pediatric emergency care.

[21]  L. Quan,et al.  The Simulation Team Assessment Tool (STAT): development, reliability and validation. , 2012, Resuscitation.

[22]  M. Auerbach,et al.  An Intervention to Improve Pain Management in the Pediatric Emergency Department , 2012, Pediatric emergency care.

[23]  M. Auerbach,et al.  Simulation Training with Structured Debriefing Improves Residents’ Pediatric Disaster Triage Performance , 2012, Prehospital and Disaster Medicine.

[24]  Q. Doan,et al.  A Presurvey and Postsurvey of a Web- and Simulation-Based Course of Ultrasound-Guided Nerve Blocks for Pediatric Emergency Medicine , 2012, Pediatric emergency care.

[25]  Scott D. Lifchez,et al.  Hand education for emergency medicine residents: results of a pilot program. , 2012, The Journal of hand surgery.

[26]  R. Jeanmonod,et al.  The effect of education in hospice and palliative care on emergency medicine residents' knowledge and referral patterns. , 2012, Journal of palliative medicine.

[27]  Linda L. Brown,et al.  A medical simulation-based educational intervention for emergency medicine residents in neonatal resuscitation. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[28]  A. Morrison,et al.  Psychiatry and Emergency Medicine: Medical Student and Physician Attitudes Toward Homeless Persons , 2012, Academic Psychiatry.

[29]  Ruth Brown,et al.  Development and validation of a tool to assess emergency physicians' nontechnical skills. , 2012, Annals of emergency medicine.

[30]  Jacqueline Gordón Emergency department junior medical staff’s knowledge, skills and confidence with psychiatric patients: a survey , 2012 .

[31]  N. Kman,et al.  Faculty prefer continuity with medical students in the emergency department , 2012, Emergency Medicine Journal.

[32]  J. Fisher,et al.  Factors that influence medical student selection of an emergency medicine residency program: implications for training programs. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[33]  Jennifer A. Dunbar-Viveiros,et al.  Pilot-Phase Findings From High-fidelity In Situ Medical Simulation Investigation of Emergency Department Procedural Sedation , 2012, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[34]  M. Pusic,et al.  Prevalence of abnormal cases in an image bank affects the learning of radiograph interpretation , 2012, Medical education.

[35]  W. Pickett,et al.  Development and evaluation of a simulation-based resuscitation scenario assessment tool for emergency medicine residents. , 2012, CJEM.

[36]  J. Leow,et al.  Mass casualty incident training in a resource‐limited environment , 2012, The British journal of surgery.

[37]  T. Chiu,et al.  Mini-clinical evaluation exercise and feedback on postgraduate trainees in the emergency department: A qualitative content analysis , 2012 .

[38]  G. Keijzers,et al.  The effect of a chest imaging lecture on emergency department doctors’ ability to interpret chest CT images: a randomized study , 2012, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[39]  V. LeBlanc,et al.  Impact of stress on resident performance in simulated trauma scenarios , 2012, The journal of trauma and acute care surgery.

[40]  Y. Steinert,et al.  The retrospective pre-post: a practical method to evaluate learning from an educational program. , 2012, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[41]  E. Reibling,et al.  Student Perception of High Fidelity Medical Simulation for an International Trauma Life Support Course , 2012, Prehospital and Disaster Medicine.

[42]  Jeffrey M. Franc,et al.  Increasing Emergency Medicine Residents’ Confidence in Disaster Management: Use of an Emergency Department Simulator and an Expedited Curriculum , 2012, Prehospital and Disaster Medicine.

[43]  Erden Kilic,et al.  Communication skills training for emergency medicine residents , 2012, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[44]  Daniel J Langsam,et al.  An Educational Video Improves Technique in Performance of Pediatric Lumbar Punctures , 2012, Pediatric emergency care.

[45]  C. Vincent,et al.  Teams under pressure in the emergency department: an interview study , 2011, Emergency Medicine Journal.

[46]  I. Jo,et al.  Basic life support skill retention of medical interns and the effect of clinical experience of cardiopulmonary resuscitation , 2011, Emergency Medicine Journal.

[47]  J. Fisher,et al.  Critical appraisal of emergency medicine educational research: the best publications of 2010. , 2011, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[48]  T. Chiu,et al.  A multinational randomised study comparing didactic lectures with case scenario in a severe sepsis medical simulation course , 2011, Emergency Medicine Journal.

[49]  J. Fisher,et al.  Critical appraisal of emergency medicine educational research: the best publications of 2009. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[50]  L. Jack,et al.  Appraising Qualitative Research in Health Education: Guidelines for Public Health Educators , 2010, Health promotion practice.

[51]  J. Fisher,et al.  Highlights in emergency medicine medical education research: 2008. , 2009, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[52]  David A Cook,et al.  Association between funding and quality of published medical education research. , 2007, JAMA.

[53]  David R. Jones,et al.  Appraising qualitative research for inclusion in systematic reviews: a quantitative and qualitative comparison of three methods , 2007, Journal of health services research & policy.

[54]  Luc Côté,et al.  Appraising qualitative research articles in medicine and medical education , 2005, Medical teacher.

[55]  Linda Hutchinson,et al.  Evaluating and researching the effectiveness of educational interventions , 1999, BMJ.

[56]  L. Sjodahl Evaluation of Training. , 1975 .

[57]  S. Mahler,et al.  The impact of emergency department overcrowding on resident education. , 2012, The Journal of emergency medicine.

[58]  Matthew S. Prewett,et al.  Teamwork in the trauma room evaluation of a multimodal team training program , 2012, Journal of emergencies, trauma, and shock.

[59]  Jeanne Daly,et al.  A hierarchy of evidence for assessing qualitative health research. , 2007, Journal of clinical epidemiology.

[60]  E. Boyer Scholarship Reconsidered: Priorities of the Professoriate , 1990 .

[61]  Robert L. Craig,et al.  Training and development handbook: A guide to human resource development , 1976 .

[62]  Sarah Mckay The Carnegie Foundation for the Advancement of Teaching , 1914, Nature.