Can performance indicators be used for pedagogic purposes in disaster medicine training?

BackgroundAlthough disaster simulation trainings were widely used to test hospital disaster plans and train medical staff, the teaching performance of the instructors in disaster medicine training has never been evaluated. The aim of this study was to determine whether the performance indicators for measuring educational skill in disaster medicine training could indicate issues that needed improvement.MethodsThe educational skills of 15 groups attending disaster medicine instructor courses were evaluated using 13 measurable performance indicators. The results of each indicator were scored at 0, 1 or 2 according to the teaching performance.ResultsThe total summed scores ranged from 17 to 26 with a mean of 22.67. Three indicators: 'Design', 'Goal' and 'Target group' received the maximum scores. Indicators concerning running exercises had significantly lower scores as compared to others.ConclusionPerformance indicators could point out the weakness area of instructors' educational skills. Performance indicators can be used effectively for pedagogic purposes.

[1]  Tore Vikström,et al.  Staff Procedure Skills in Management Groups during Exercises in Disaster Medicine , 2007, Prehospital and Disaster Medicine.

[2]  S. Lennquist,et al.  Promotion of Disaster Medicine to a scientific discipline – a slow and painful, but necessary process , 2003 .

[3]  D. Kilroy.  Teaching the trauma teachers: an international review of the Advanced Trauma Life Support Instructor Course , 2007, Emergency Medicine Journal.

[4]  G. Moss.  Advanced Trauma Life Support instructor training in the UK: an evaluation. , 1998, Postgraduate medical journal.

[5]  R. Lewis,et al.  Assessment of the reliability of the Johns Hopkins/Agency for Healthcare Research and Quality hospital disaster drill evaluation tool. , 2008, Annals of emergency medicine.

[6]  Rodney Franks,et al.  A strategic plan for disaster medicine in Australasia. , 2003, Emergency medicine.

[7]  Kelly R Klein,et al.  The Use of Trained Observers as an Evaluation Tool for a Multi-Hospital Bioterrorism Exercise , 2005, Prehospital and Disaster Medicine.

[8]  E. Dar-El,et al.  Skill retention and relearning – a proposed cyclical model , 2000 .

[9]  J. Merrill,et al.  Role of Exercises and Drills in the Evaluation of Public Health in Emergency Response , 2006, Prehospital and Disaster Medicine.

[10]  奥寺 敬,et al.  新しくなったEmergo Train Systemの教育システム , 2011 .

[11]  S. Neequaye,et al.  Should we train the trainers? Results of a randomized trial. , 2008, Journal of the American College of Surgeons.

[12]  J. Stella,et al.  What a Disaster?! Assessing Utility of Simulated Disaster Exercise and Educational Process for Improving Hospital Preparedness , 2006, Prehospital and Disaster Medicine.

[13]  R. Levine,et al.  Teaching the teachers: national survey of faculty development in departments of medicine of U.S. teaching hospitals. , 2004, Journal of general internal medicine.

[14]  N. Notzer,et al.  Can brief workshops improve clinical instruction? , 2008, Medical education.

[15]  Anders Rüter,et al.  Performance Indicators for Major Incident Medical Management – A Possible Tool for Quality Control? , 2004 .

[16]  Heléne Nilsson,et al.  Performance Indicators as Quality Control for Testing and Evaluating Hospital Management Groups: A Pilot Study , 2006, Prehospital and Disaster Medicine.

[17]  Roger J Lewis,et al.  Assessing hospital disaster preparedness: a comparison of an on-site survey, directly observed drill performance, and video analysis of teamwork. , 2008, Annals of emergency medicine.

[18]  Anders Rüter,et al.  Performance indicators for prehospital command and control in training of medical first responders , 2004 .