Linking assessment to undergraduate student capabilities through portfolio examination

Portfolios are an established method of assessment, although concerns do exist around their validity for capabilities such as reflection and self‐direction. This article describes an e‐portfolio which closely aligns learning and reflection to graduate capabilities, incorporating features that address concerns about portfolios. Students are required to complete assessments linked to graduate capabilities. In Year 3, a portfolio review occurs (205–248 students per year), focusing on students' grades and feedback from assessments and a reflective essay is submitted. In the essay, students reflect on their progress, identify areas of weakness and detail plans for improvement. Progress in each capability is summatively graded against specific criteria and feedback is provided. Students progressively accumulate evidence of learning linked to the graduate capabilities. The provision of sufficient structure prevents evasion of areas of weakness. Importantly, the equal weighting given to all graduate capabilities emphasises that competence in all areas is required. The requirement for a degree of self‐direction and reflection in all assessments promotes regular review of progress. This e‐portfolio explicitly links graduate outcomes with assessment in order to drive learning. Further research is required to evaluate acceptability to students, as well as the efficacy of portfolios in developing reflective practice and self‐directed learning.

[1]  Enhancing reliability in portfolio assessment: 'shaping' the portfolio , 2001, Medical teacher.

[2]  M. Whitcomb.  Competency-based graduate medical education? Of course! But how should competency be assessed? , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[3]  Cees P M van der Vleuten,et al.  Use of portfolios in early undergraduate medical training , 2003, Medical teacher.

[4]  C. Rees,et al.  The trouble with assessing students' professionalism: theoretical insights from sociocognitive psychology. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[5]  Cees P M van der Vleuten,et al.  Conditions for successful reflective use of portfolios in undergraduate medical education , 2005, Medical education.

[6]  Susan M Toohey,et al.  An innovative outcomes-based medical education program built on adult learning principles , 2006, Medical teacher.

[7]  Making more of it! Medical Students’ motives for voluntarily keeping an extended portfolio , 2007, Medical teacher.

[8]  T. Inui,et al.  Fulfilling the social contract between medical schools and the public , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[9]  J. B. Leeper,et al.  Development of eMed: a comprehensive, modular curriculum-management system. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[10]  K. Parakh.  Assessment in medical education. , 2007, The New England journal of medicine.

[11]  D. Irby,et al.  Assessment in medical education. , 2007, The New England journal of medicine.

[12]  R M Harden,et al.  Developments in outcome-based education , 2002, Medical teacher.

[13]  J. Ker,et al.  Student perceptions of a portfolio assessment process , 2009, Medical education.

[14]  Jason R. Frank,et al.  The CanMEDS 2005 Physician Competency Framework , 2005 .

[15]  J van Tartwijk,et al.  The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study , 2005, Medical education.

[16]  N J Hansen,et al.  Professionalism , 2017, Getting Ready for Direct Practice in Social Work.

[17]  R M Harden,et al.  AMEE Guide No. 14: Outcome-based education: Part 5-From competency to meta-competency: a model for the specification of learning outcomes. , 1999, Medical teacher.

[18]  Val Wass,et al.  Portfolios in medical education: why do they meet with mixed success? A systematic review , 2007, Medical education.

[19]  Maggie Challis,et al.  Portfolios and assessment: meeting the challenge , 2001, Medical teacher.

[20]  P. Cantillon,et al.  The need for outcome measures in medical education , 2005, BMJ : British Medical Journal.

[21]  A. Epstein,et al.  Pay for performance at the tipping point. , 2007, The New England journal of medicine.

[22]  J. Biggs.  What the student does: teaching for enhanced learning , 1999 .

[23]  M. Lindheimer.  Case 36-2006: a pregnant woman with new hypertension. , 2007, The New England journal of medicine.

[24]  Chris Hughes,et al.  What do students want? The types of learning activities preferred by final year medical students , 2003, Medical education.

[25]  Robert Englander,et al.  ANALYSES/LITERATURE REVIEWS: Evaluating Competence Using a Portfolio: A Literature Review and Web-Based Application to the ACGME Competencies , 2004, Teaching and learning in medicine.

[26]  C. Rees,et al.  The reliability of assessment criteria for undergraduate medical students' communication skills portfolios: the Nottingham experience , 2004, Medical education.

[27]  G. Velan,et al.  eMed Teamwork: a self-moderating system to gather peer feedback for developing and assessing teamwork skills , 2008, Medical teacher.

[28]  Chris Roberts,et al.  Portfolio‐based assessments in medical education: are they valid and reliable for summative purposes? , 2002, Medical education.

[29]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[30]  Maggie Challis,et al.  AMEE Medical Education Guide No.11 (revised): Portfolio-based learning and assessment in medical education , 1999 .

[31]  Elaine F Dannefer,et al.  The portfolio approach to competency-based assessment at the Cleveland Clinic Lerner College of Medicine. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[32]  Susan Toohey,et al.  A New Program of Assessment for a New Medical Program , 2003 .

[33]  A. Kalet,et al.  Promoting Professionalism through an Online Professional Development Portfolio: Successes, Joys, and Frustrations , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[34]  Charlotte Rees,et al.  Undergraduate medical students' views about a reflective portfolio assessment of their communication skills learning , 2004, Medical education.

[35]  C. Rees.  The use (and abuse) of the term ‘portfolio’ , 2005, Medical education.

[36]  V. Burch,et al.  Use of a structured interview to assess portfolio‐based learning , 2008, Medical education.

[37]  C. Carraccio,et al.  Shifting Paradigms: From Flexner to Competencies , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[38]  C. Gomar,et al.  Defining the learning outcomes of graduates from the medical school at the University of Barcelona (Catalonia, Spain) , 2004, Medical teacher.

[39]  T. Dornan,et al.  The self critical doctor: helping students become more reflective , 2008, BMJ : British Medical Journal.

[40]  M.H. Davis,et al.  Portfolio assessment in medical students' final examinations , 2001, Medical teacher.

[41]  A. Muijtjens,et al.  Web‐ or paper‐based portfolios: is there a difference? , 2007, Medical education.