Managing tensions in assessment: moving beyond either–or thinking

In health professions education, assessment systems are bound to be rife with tensions as they must fulfil formative and summative assessment purposes, be efficient and effective, and meet the needs of learners and education institutes, as well as those of patients and health care organisations. The way we respond to these tensions determines the fate of assessment practices and reform. In this study, we argue that traditional ‘fix‐the‐problem’ approaches (i.e. either–or solutions) are generally inadequate and that we need alternative strategies to help us further understand, accept and actually engage with the multiple recurring tensions in assessment programmes.

[1]  L. Lingard 2. Rethinking Competence in The Context of Teamwork , 2018, The Question of Competence.

[2]  Clemet Askheim,et al.  Politics and Power in Global Health : The Constituting Role of Conflicts Comment on “ Navigating Between Stealth Advocacy and Unconscious Dogmatism : The Challenge of Researching the Norms , Politics and Power of Global Health ” , 2018 .

[3]  C. V. D. van der Vleuten,et al.  Stakes in the eye of the beholder: an international study of learners’ perceptions within programmatic assessment , 2018, Medical education.

[4]  I. Heyligers,et al.  Effects of implementing time-variable postgraduate training programmes on the organization of teaching hospital departments , 2018, Medical teacher.

[5]  R. Brydges,et al.  Competency‐based medical education: the discourse of infallibility , 2018, Medical education.

[6]  P. Cantillon,et al.  Navigating the system: Physiotherapy student perceptions of performance-based assessment , 2017, Medical teacher.

[7]  Jonathan Sherbino,et al.  Mixed Messages or Miscommunication? Investigating the Relationship Between Assessors’ Workplace-Based Assessment Scores and Written Comments , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[8]  I. Heyligers,et al.  Flexible competency based medical education: More time efficient, higher costs , 2017, Medical teacher.

[9]  Yvonne Steinert,et al.  Qualitative and quantitative feedback in the context of competency-based education , 2017, Medical teacher.

[10]  E. Krupat Critical Thoughts About the Core Entrustable Professional Activities in Undergraduate Medical Education , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[11]  J. Frank,et al.  Core principles of assessment in competency-based medical education , 2017, Medical teacher.

[12]  S. Ross,et al.  Evolving concepts of assessment in a competency-based world , 2017, Medical teacher.

[13]  J. Frank,et al.  Implementing competency-based medical education: What changes in curricular structure and processes are needed? , 2017, Medical teacher.

[14]  J. Frank,et al.  A call to action: The controversy of and rationale for competency-based medical education , 2017, Medical teacher.

[15]  Christopher J. Harrison,et al.  Changing the culture of assessment: the dominance of the summative assessment paradigm , 2017, BMC medical education.

[16]  C. V. D. van der Vleuten,et al.  “It's Just Not the Culture”: A Qualitative Study Exploring Residents' Perceptions of the Impact of Institutional Culture on Feedback , 2017, Teaching and learning in medicine.

[17]  J. Gilhooly,et al.  Building a Framework of Entrustable Professional Activities, Supported by Competencies and Milestones, to Bridge the Educational Continuum. , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[18]  David A. Fleming,et al.  The Charter on Professionalism for Health Care Organizations , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[19]  Kevin W Eva,et al.  Towards a program of assessment for health professionals: from training into practice , 2016, Advances in health sciences education : theory and practice.

[20]  L. Lingard,et al.  ‘Sometimes the work just needs to be done’: socio‐cultural influences on direct observation in medical training , 2016, Medical education.

[21]  Christopher J. Harrison,et al.  Factors influencing students’ receptivity to formative feedback emerging from different assessment cultures , 2016, Perspectives on medical education.

[22]  J. Ali,et al.  Workplace-based assessment: a review of user perceptions and strategies to address the identified shortcomings , 2015, Advances in Health Sciences Education.

[23]  A. Noyes,et al.  To grade or not to grade: balancing formative and summative assessment in post-16 teacher trainee observations , 2016 .

[24]  Lorelei Lingard,et al.  Hedging to save face: a linguistic analysis of written comments on in-training evaluation reports , 2016, Advances in health sciences education : theory and practice.

[25]  T. Roberts,et al.  Trends in national licensing examinations in medicine , 2016, Medical education.

[26]  S. Shaha,et al.  Guiding health care transformation: A next-generation, diagnostic remediation tool for leveraging polarities. , 2015, Nursing outlook.

[27]  S. Reddy,et al.  Development and Evaluation of Standardized Narrative Cases Depicting the General Surgery Professionalism Milestones , 2015, Academic medicine : journal of the Association of American Medical Colleges.

[28]  Sylvia Heeneman,et al.  The impact of programmatic assessment on student learning: theory versus practice , 2015, Medical education.

[29]  B. Hodges,et al.  Assessing competencies using milestones along the way , 2015, Medical teacher.

[30]  Karen D. Könings,et al.  Barriers to the uptake and use of feedback in the context of summative assessment , 2015, Advances in health sciences education : theory and practice.

[31]  David A Cook,et al.  A systematic review of validity evidence for checklists versus global rating scales in simulation‐based assessment , 2015, Medical education.

[32]  Cees P M van der Vleuten,et al.  Perceived Effects of Innovations in Postgraduate Medical Education: A Q Study Focusing on Workplace-Based Assessment , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[33]  L. Lingard,et al.  Learning culture and feedback: an international study of medical athletes and musicians , 2014, Medical education.

[34]  Barry W. Johnson Reflections A Perspective on Paradox and Its Application to Modern Management , 2014 .

[35]  William F Iobst,et al.  Reconceptualizing variable rater assessments as both an educational and clinical care problem. , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[36]  S. van Dulmen,et al.  Residents' perceived barriers to communication skills learning: comparing two medical working contexts in postgraduate training. , 2014, Patient education and counseling.

[37]  Geoff Norman,et al.  Competency-based education: milestones or millstones? , 2014, Journal of graduate medical education.

[38]  Wendy K. Smith,et al.  Paradox as a Metatheoretical Perspective , 2014 .

[39]  Loizos Heracleous,et al.  Singapore Airlines , 2014 .

[40]  M. Govaerts,et al.  Validity in work‐based assessment: expanding our horizons , 2013, Medical education.

[41]  J. Hanson,et al.  Narrative descriptions should replace grades and numerical ratings for clinical performance in medical education in the United States , 2013, Front. Psychol..

[42]  J. Ali Getting lost in translation? Workplace based assessments in surgical training. , 2013, The surgeon : journal of the Royal Colleges of Surgeons of Edinburgh and Ireland.

[43]  T. Dornan,et al.  Outcome (competency) based education: an exploration of its origins, theoretical basis, and empirical evidence , 2013, Advances in health sciences education : theory and practice.

[44]  C. V. D. van der Vleuten,et al.  Programmatic assessment of competency-based workplace learning: when theory meets practice , 2013, BMC Medical Education.

[45]  F. Scheele,et al.  What is wrong with assessment in postgraduate training? Lessons from clinical practice and educational research , 2013, Medical teacher.

[46]  B. Hodges Assessment in the post-psychometric era: Learning to love the subjective and collective , 2013, Medical teacher.

[47]  F. Luhanga,et al.  Exploring the Issue of Failure to Fail in a Nursing Program , 2013, International journal of nursing education scholarship.

[48]  L. Lingard,et al.  Beyond individualism: professional culture and its influence on feedback , 2013, Medical education.

[49]  A. Nowacki Making the Grade in a Portfolio-Based System: Student Performance and the Student Perspective , 2013, Front. Psychol..

[50]  K. Eva,et al.  Scylla or Charybdis? Can we navigate between objectification and judgement in assessment? , 2012, Medical education.

[51]  J. Katzenbach,et al.  Cultural change that sticks. , 2012, Harvard business review.

[52]  M. Harrison How the Growth Outliers Do It , 2012 .

[53]  G. Regehr,et al.  Using “Standardized Narratives” to Explore New Ways to Represent Faculty Opinions of Resident Performance , 2012, Academic medicine : journal of the Association of American Medical Colleges.

[54]  B. Doebbeling,et al.  Lessons From the Field: The Essential Elements for Point-of-Care Transformation , 2011, Medical care.

[55]  Alfie Kohn,et al.  The Case against Grades. , 2011 .

[56]  Wendy K. Smith,et al.  Toward a Theory of Paradox: A Dynamic equilibrium Model of Organizing , 2011 .

[57]  H. Fineberg,et al.  Health professionals for a new century: transforming education to strengthen health systems in an interdependent world , 2010, The Lancet.

[58]  Jonathan Sherbino,et al.  The role of assessment in competency-based medical education , 2010, Medical teacher.

[59]  Chrysan Gallucci,et al.  Negotiating Implementation of High-Stakes Performance Assessment Policies in Teacher Education: From Compliance to Inquiry , 2010 .

[60]  G. Regehr,et al.  Toward Authentic Clinical Evaluation: Pitfalls in the Pursuit of Competency , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[61]  David M. Irby,et al.  Calls for Reform of Medical Education by the Carnegie Foundation for the Advancement of Teaching: 1910 and 2010 , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[62]  Maddalena Taras Summative assessment: the missing link for formative assessment , 2009 .

[63]  R. Harden Five myths and the case against a European or national licensing examination , 2009, Medical teacher.

[64]  W. Abuznadah,et al.  The need for national medical licensing examination in Saudi Arabia , 2008, BMC medical education.

[65]  V. Shute Focus on Formative Feedback , 2008 .

[66]  K. Parakh Assessment in medical education. , 2007, The New England journal of medicine.

[67]  S. Kvale,et al.  Contradictions of assessment for learning in institutions of higher learning , 2007 .

[68]  J. Hattie,et al.  The Power of Feedback , 2007 .

[69]  D. Irby,et al.  Assessment in medical education. , 2007, The New England journal of medicine.

[70]  L. Schuwirth,et al.  A plea for new psychometric models in educational assessment , 2006, Medical education.

[71]  Brian Hodges,et al.  Medical education and the maintenance of incompetence , 2006, Medical teacher.

[72]  V. Wass Ensuring medical students are “fit for purpose” , 2005, BMJ : British Medical Journal.

[73]  Glenn Regehr,et al.  Failure to Fail: The Perspectives of Clinical Supervisors , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[74]  H. McNeil,et al.  Riluzole : a glimmer of hope in the treatment of motor neurone disease , 2022 .

[75]  D. R. Sadler * Interpretations of criteria‐based assessment and grading in higher education , 2005 .

[76]  M. Stockler,et al.  Achieving equal standards in medical student education: is a national exit examination the answer? , 2005, Medical Journal of Australia.

[77]  Clive Seale,et al.  The hidden curriculum in undergraduate medical education: qualitative study of medical students' perceptions of teaching , 2004, BMJ : British Medical Journal.

[78]  M. Talbot Monkey see, monkey do: a critique of the competency model in graduate medical education , 2004, Medical education.

[79]  Jennifer Crocker,et al.  When grades determine self-worth: consequences of contingent self-worth for male and female engineering and psychology majors. , 2003, Journal of personality and social psychology.

[80]  Eleanor Hawe,et al.  'It's Pretty Difficult to Fail': The reluctance of lecturers to award a failing grade , 2003 .

[81]  Patrice L Spath,et al.  Using failure mode and effects analysis to improve patient safety. , 2003, AORN journal.

[82]  W. Leung,et al.  Learning in practice , 2002, BMJ : British Medical Journal.

[83]  Joseph M. Derosier,et al.  Using health care Failure Mode and Effect Analysis: the VA National Center for Patient Safety's prospective risk analysis system. , 2002, The Joint Commission journal on quality improvement.

[84]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[85]  John Maddox,et al.  What are the risks? , 1994, Nature.

[86]  G. Norman,et al.  Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability , 1991, Medical education.

[87]  A. V. D. Ven,et al.  Using Paradox to Build Management and Organization Theories , 1989 .

[88]  T. Crooks The Impact of Classroom Evaluation Practices on Students , 1988 .

[89]  L. Lingard,et al.  The Question of Competence: Reconsidering Medical Education in the Twenty-First Century , 2014 .

[90]  Kenneth R. Favaro,et al.  The Three Tensions: Winning the Struggle to Perform Without Compromise , 2007 .

[91]  G R Norman,et al.  The risks of thoroughness: Reliability and validity of global ratings and checklists in an OSCE , 1996, Advances in health sciences education : theory and practice.