Towards developing a consensus assessment framework for global emergency medicine fellowships

BackgroundThe number of Global Emergency Medicine (GEM) Fellowship training programs are increasing worldwide. Despite the increasing number of GEM fellowships, there is not an agreed upon approach for assessment of GEM trainees.Main bodyIn order to study the lack of standardized assessment in GEM fellowship training, a working group was established between the International EM Fellowship Consortium (IEMFC) and the International Federation for Emergency Medicine (IFEM). A needs assessment survey of IEMFC members and a review were undertaken to identify assessment tools currently in use by GEM fellowship programs; what relevant frameworks exist; and common elements used by programs with a wide diversity of emphases. A consensus framework was developed through iterative working group discussions. Thirty-two of 40 GEM fellowships responded (80% response). There is variability in the use and format of formal assessment between programs. Thirty programs reported training GEM fellows in the last 3 years (94%). Eighteen (56%) reported only informal assessments of trainees. Twenty-seven (84%) reported regular meetings for assessment of trainees. Eleven (34%) reported use of a structured assessment of any sort for GEM fellows and, of these, only 2 (18%) used validated instruments modified from general EM residency assessment tools. Only 3 (27%) programs reported incorporation of formal written feedback from partners in other countries. Using these results along with a review of the available assessment tools in GEM the working group developed a set of principles to guide GEM fellowship assessments along with a sample assessment for use by GEM fellowship programs seeking to create their own customized assessments.ConclusionThere are currently no widely used assessment frameworks for GEM fellowship training. The working group made recommendations for developing standardized assessments aligned with competencies defined by the programs, that characterize goals and objectives of training, and document progress of trainees towards achieving those goals. Frameworks used should include perspectives of multiple stakeholders including partners in other countries where trainees conduct field work. Future work may evaluate the usability, validity and reliability of assessment frameworks in GEM fellowship training.

[1]  C. Boelen Prospects for change in medical education in the twenty‐first century , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[2]  R. Cydulka,et al.  Evaluation of resident performance and intensive bedside teaching during direct observation. , 1996, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[3]  T. Kirsch,et al.  Proposed fellowship training program in international emergency medicine. , 1999, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[4]  S. Hayden,et al.  Definitions and competencies for practice-based learning and improvement. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[5]  W. Burdick,et al.  Clinical assessment in emergency medicine. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[6]  P. Dyne,et al.  Systems-based practice: the sixth core competency. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  G. Larkin,et al.  Defining and evaluating professionalism: a core competency for graduate emergency medicine education. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[8]  Hilde van der Togt,et al.  Publisher's Note , 2003, J. Netw. Comput. Appl..

[9]  C. Laurence The Winston Churchill Memorial Trust of Australia , 2003 .

[10]  C. V. D. van der Vleuten,et al.  Assessing professional competence : from methods to programmes , 2005 .

[11]  C. Holliman,et al.  Lessons learned from international emergency medicine development. , 2005, Emergency medicine clinics of North America.

[12]  Cees P. M. van der Vleuten,et al.  Assessing professional competence: from methods to programmes , 2005 .

[13]  Jason R. Frank,et al.  The CanMEDS 2005 Physician Competency Framework: Better standards. Better physicians. Better care. , 2005 .

[14]  J. Norcini,et al.  Workplace-based assessment as an educational tool: AMEE Guide No. 31 , 2007, Medical teacher.

[15]  V. Wass,et al.  Assessment in medical education and training 1 , 2008 .

[16]  Jovica R. Riznic,et al.  The Logical Framework Approach-Millennium , 2009 .

[17]  C. V. D. van der Vleuten,et al.  The assessment of professional competence: building blocks for theory development. , 2010, Best practice & research. Clinical obstetrics & gynaecology.

[18]  Jamil D. Bayram,et al.  Core curricular elements for fellowship training in international emergency medicine. , 2010, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[19]  C. Vleuten Programmatic assessment: From assessment of learning to assessment for learning , 2011 .

[20]  P. Cameron,et al.  International Federation for Emergency Medicine Model Curriculum for Emergency Medicine Specialists , 2011, Emergency medicine Australasia : EMA.

[21]  C. V. D. van der Vleuten,et al.  Programmatic assessment: From assessment of learning to assessment for learning , 2011, Medical teacher.

[22]  C. V. D. van der Vleuten,et al.  A model for programmatic assessment fit for purpose , 2012, Medical teacher.

[23]  Jamil D. Bayram,et al.  Fellowships in international emergency medicine in the USA: a comparative survey of program directors’ and fellows’ perspectives on the curriculum , 2013, Postgraduate Medical Journal.

[24]  Jiabin Shen,et al.  Identifying interprofessional global health competencies for 21st-century health professionals. , 2015, Annals of global health.

[25]  C. V. D. van der Vleuten,et al.  Designing Assessment Programmes for the Model Curriculum for Emergency Medicine Specialists. , 2015, CJEM.

[26]  Q. Eichbaum The Problem With Competencies in Global Health Education , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[27]  G. Jacquet,et al.  Development of a Global Health Milestones Tool for Learners in Emergency Medicine: A Pilot Project , 2017, AEM education and training.