International consensus statement on the assessment of interprofessional learning outcomes

Abstract Regulatory frameworks around the world mandate that health and social care professional education programs graduate practitioners who have the competence and capability to practice effectively in interprofessional collaborative teams. Academic institutions are responding by offering interprofessional education (IPE); however, there is as yet no consensus regarding optimal strategies for the assessment of interprofessional learning (IPL). The Program Committee for the 17th Ottawa Conference in Perth, Australia in March, 2016, invited IPE champions to debate and discuss the current status of the assessment of IPL. A draft statement from this workshop was further discussed at the global All Together Better Health VIII conference in Oxford, UK in September, 2016. The outcomes of these deliberations and a final round of electronic consultation informed the work of a core group of international IPE leaders to develop this document. The consensus statement we present here is the result of the synthesized views of experts and global colleagues. It outlines the challenges and difficulties but endorses a set of desired learning outcome categories and methods of assessment that can be adapted to individual contexts and resources. The points of consensus focus on pre-qualification (pre-licensure) health professional students but may be transferable into post-qualification arenas.

[1]  George H. Kidd,et al.  General Medical Council , 1889 .

[2]  A. Lansing,et al.  Canadian Medical Association , 1889, British medical journal.

[3]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[4]  J. Stanley,et al.  Book Review: Taxonomy of Educational Objectives, The Classification of Educational Goals, Handbook I: Cognitive Domain , 1957 .

[5]  C. Dolea,et al.  World Health Organization , 1949, International Organization.

[6]  Richard W. Morshead.  Taxonomy of Educational Objectives Handbook II: Affective Domain , 1965 .

[7]  B. Bloom,et al.  Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , 1966 .

[8]  G. Miller.  The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[9]  Schwarz Mr.  Liaison Committee on Medical Education. Past successes, future challenges. , 1992 .

[10]  D. Kassebaum.  Origin of the LCME, the AAMC‐AMA partnership for accreditation , 1992, Academic medicine : journal of the Association of American Medical Colleges.

[11]  Liaison Committee on Medical Education. Past successes, future challenges. , 1992, JAMA.

[12]  J. Horder.  A national survey that needs to be repeated: Centre for the Advancement of Interprofessional Education , 1992 .

[13]  A. Muijtjens,et al.  Relative or Absolute Standards in Assessing Medical Knowledge Using Progress Tests , 1998, Advances in health sciences education : theory and practice.

[14]  G. Parsell,et al.  The development of a questionnaire to assess the readiness of health care students for interprofessional learning (RIPLS) , 1999, Medical education.

[15]  D. Boud.  Sustainable Assessment: Rethinking assessment for the learning society , 2000 .

[16]  Nonaccredited medical education in the United States. , 2000, The New England journal of medicine.

[17]  D. Freeth.  Sustaining interprofessional collaboration , 2001, Journal of interprofessional care.

[18]  T. Greenhalgh,et al.  Complexity and clinical care , 2001, BMJ : British Medical Journal.

[19]  Sarah W. Fraser,et al.  Coping with complexity: educating for capability , 2001, BMJ : British Medical Journal.

[20]  Brian D. Fisher,et al.  University of British Columbia , 2002, INTR.

[21]  Jo McKenzie,et al.  SPARK, a confidential web-based template for self and peer assessment of student teamwork: benefits of evaluating across different subjects , 2002, Br. J. Educ. Technol..

[22]  Alison Moore,et al.  Learning to listen. , 2002, Nursing older people.

[23]  J. Norcini,et al.  The Mini-CEX: A Method for Assessing Clinical Skills , 2003, Annals of Internal Medicine.

[24]  D. Fraser,et al.  Evaluation of a formative interprofessional team objective structured clinical examination (ITOSCE): a method of shared learning in maternity education , 2003, Medical teacher.

[25]  Imad H. Elhajj,et al.  Turning Student Groups into Effective Teams , 2004 .

[26]  C. Watkins,et al.  “Do none of you talk to each other?”: the challenges facing the implementation of interprofessional education * , 2004, Medical teacher.

[27]  C. V. D. van der Vleuten,et al.  Assessing professional competence : from methods to programmes , 2005 .

[28]  J. Gilbert.  Interprofessional learning and higher education structural barriers , 2005, Journal of interprofessional care.

[29]  Ivy Oandasan,et al.  Key elements for interprofessional education. Part 1: The learner, the educator and the learning context , 2005, Journal of interprofessional care.

[30]  Y. Steinert.  Learning together to teach together: Interprofessional education and faculty development , 2005, Journal of interprofessional care.

[31]  Cees P. M. van der Vleuten,et al.  Assessing professional competence: from methods to programmes , 2005 .

[32]  C. Herbert.  Changing the culture: Interprofessional education for collaborative patient-centred practice in Canada , 2005, Journal of interprofessional care.

[33]  H. Barr,et al.  Mainstreaming interprofessional education in the United Kingdom: A position paper , 2006, Journal of interprofessional care.

[34]  G. Moore,et al.  Educating interprofessional learners for quality, safety and systems improvement , 2006, Journal of interprofessional care.

[35]  J. McLachlan,et al.  The relationship between assessment and learning , 2006, Medical education.

[36]  Joint Assessment in Inter‐professional Education: A Consideration of Some of the Difficulties , 2007 .

[37]  T. Dornan,et al.  Experience‐based learning: a model linking the processes and outcomes of medical students' workplace learning , 2007, Medical education.

[38]  Ben Graffam,et al.  Active learning in medical education: Strategies for beginning implementation , 2007, Medical teacher.

[39]  Richard L. Cruess,et al.  Expectations and Obligations: Professionalism and Medicine’s Social Contract with Society , 2008, Perspectives in biology and medicine.

[40]  G. Boulton‐Lewis.  Teaching for quality learning at university , 2008 .

[41]  S. Reeves,et al.  Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes. , 2009, The Cochrane database of systematic reviews.

[42]  L. Dahlgren,et al.  Twenty years experiences of interprofessional education in Linköping – ground-breaking and sustainable , 2009, Journal of interprofessional care.

[43]  K. Mann,et al.  Reflection and reflective practice in health professions education: a systematic review , 2009, Advances in health sciences education : theory and practice.

[44]  E. Anderson,et al.  The Leicester Model of Interprofessional Education: Developing, delivering and learning from student voices for 10 years , 2009, Journal of interprofessional care.

[45]  L. Nissen,et al.  Interprofessional education in health sciences: the University of Queensland Health Care Team Challenge , 2009, The Medical journal of Australia.

[46]  Carol Carraccio,et al.  Medical competence: The interplay between individual ability and the health care environment , 2010, Medical teacher.

[47]  Lesley Bainbridge,et al.  A National Interprofessional Competency Framework , 2010 .

[48]  Mary Dixon-Woods,et al.  Why is Patient Safety so Hard? A Selective Review of Ethnographic Studies , 2010, Journal of health services research & policy.

[49]  H. Fineberg,et al.  Health professionals for a new century: transforming education to strengthen health systems in an interdependent world , 2010, The Lancet.

[50]  Tanya Horsley,et al.  Toward a definition of competency-based education in medicine: a systematic review of published definitions , 2010, Medical teacher.

[51]  Asking new questions with qualitative research: A reflection on AMEE 2009 , 2010, Medical teacher.

[52]  P. Baker,et al.  Framework for action on interprofessional education and collaborative practice , 2010 .

[53]  Lynn Casimiro,et al.  Establishing face and content validity of the McMaster-Ottawa team observed structured clinical encounter (TOSCE) , 2011, Journal of interprofessional care.

[54]  V. Curran,et al.  Development and validation of the interprofessional collaborator assessment rubric ((ICAR)) , 2011, Journal of interprofessional care.

[55]  E. Anderson,et al.  Learning to listen: Improving students' communication with disabled people , 2011, Medical teacher.

[56]  S. Reeves,et al.  Assessment of interprofessional learning: the design of an interprofessional objective structured clinical examination (iOSCE) approach , 2011, Journal of interprofessional care.

[57]  Peggy Soule Odegard,et al.  Interprofessional collaboration: three best practice models of interprofessional education , 2011, Medical Education Online.

[58]  A. Taniguchi,et al.  A method to enhance student teams in palliative care: piloting the McMaster-Ottawa Team Observed Structured Clinical Encounter. , 2011, Journal of palliative medicine.

[59]  S. Lurie,et al.  History and practice of competency‐based assessment , 2012, Medical education.

[60]  S. Reeves.  The rise and rise of interprofessional competence , 2012, Journal of interprofessional care.

[61]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[62]  Impacts of interprofessional simulation on affective learning among medical students: Qualitative analysis from the CLEIMS study. , 2012 .

[63]  David Boud,et al.  Changing conceptions of feedback , 2013 .

[64]  Chris Kenaszchuk.  An inventory of quantitative tools measuring interprofessional education and collaborative practice outcomes , 2013 .

[65]  T. Hoffmann,et al.  Urinary alkalisation for uncomplicated urinary tract infection , 2013 .

[66]  S. Reeves,et al.  Interprofessional education: effects on professional practice and healthcare outcomes (update). , 2013, The Cochrane database of systematic reviews.

[67]  Developing Community-engaged Interprofessional Education in the Philippines , 2014 .

[68]  Joy C MacDermid,et al.  Scoping review of patient-centered care approaches in healthcare , 2014, BMC Health Services Research.

[69]  Charting inspiration: Development and evaluation of a tool to measure health professional student learning in the affective domain , 2014 .

[70]  Threshold learning outcomes: a framework for incorporating professional accreditation and AQF standards into assessment blueprinting/mapping in healthcare disciplines , 2014 .

[71]  H. McConnell,et al.  A randomised controlled trial of extended immersion in multi-method continuing simulation to prepare senior medical students for practice as junior doctors , 2014, BMC medical education.

[72]  Jill Thistlethwaite,et al.  Curriculum renewal for interprofessional education in health , 2014 .

[73]  Interprofessional Education in Canada: Initiatives 2003–11 , 2014 .

[74]  G. Rogers,et al.  Competencies and Frameworks in Interprofessional Education: A Comparative Analysis , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[75]  E. Anderson,et al.  Students improve patient care and prepare for professional practice: An interprofessional community-based study , 2014, Medical teacher.

[76]  Establishing ‘health professions literacy’: Evaluation of a video‐based learning package in a three‐phase curriculum , 2014 .

[77]  Assessment of Interprofessional Teamwork — An International Perspective , 2015 .

[78]  S. Reeves,et al.  The Readiness for Interprofessional Learning Scale (RIPLS): A problematic evaluative scale for the interprofessional field , 2015, Journal of interprofessional care.

[79]  Christina C. Chang,et al.  Antiviral prophylaxis for varicella zoster in immunocompromised patients (excluding haematological malignancies) , 2015 .

[80]  J. Thistlethwaite,et al.  An exploratory review of pre-qualification interprofessional education evaluations , 2015, Journal of interprofessional care.

[81]  Patient Outcomes.  COMMITTEE ON MEASURING THE IMPACT OF INTERPROFESSIONAL EDUCATION ON COLLABORATIVE PRACTICE AND PATIENT OUTCOMES , 2015 .

[82]  M. O’Reilly,et al.  Assessing interprofessional competence using a prospective reflective portfolio , 2015, Journal of interprofessional care.

[83]  W. McGaghie,et al.  Variables that affect the process and outcome of feedback, relevant for medical training: a meta‐review , 2015, Medical education.

[84]  M. Davidson,et al.  A critical appraisal of instruments to measure outcomes of interprofessional education , 2015, Medical education.

[85]  J. Thistlethwaite,et al.  Work based assessment of teamwork: an interprofessional approach. , 2015 .

[86]  S. Reeves,et al.  Interprofessional collaborative patient-centred care: a critical exploration of two related discourses , 2015, Journal of interprofessional care.

[87]  E. Anderson,et al.  Learning to be interprofessional through the use of reflective portfolios? , 2016 .

[88]  M. Hammick,et al.  Evaluating an interprofessional education curriculum: A theory-informed approach , 2015, Medical teacher.

[89]  The power of the written word: team assessment of behaviour , 2016, Medical education.

[90]  S. Reeves,et al.  Using a meta-ethnographic approach to explore the nature of facilitation and teaching approaches employed in interprofessional education , 2016, Medical teacher.

[91]  J. Thistlethwaite,et al.  Introducing the individual Teamwork Observation and Feedback Tool (iTOFT): Development and description of a new interprofessional teamwork measure , 2016, Journal of interprofessional care.

[92]  S. Reeves,et al.  Interprofessional education guidelines 2016 , 2016 .

[93]  Andrew Teodorczuk,et al.  Developing interprofessional education: putting theory into practice , 2016, The clinical teacher.

[94]  A. Beurskens,et al.  Interprofessional collaboration regarding patients’ care plans in primary care: a focus group study into influential factors , 2016, BMC Family Practice.

[95]  M. Jalili,et al.  Development of a comprehensive clinical performance assessment system for nursing students: A programmatic approach. , 2016, Japan journal of nursing science : JJNS.

[96]  I. Sakai,et al.  Development of an interprofessional competency framework in Japan , 2016, Journal of interprofessional care.

[97]  G. Moineau.  Association of Faculties of Medicine of Canada response to: The unmatched by Dr. Amit Persad , 2018, Canadian medical education journal.