Portfolios for assessment and learning: AMEE Guide no. 45

In 1990, Miller wrote that no tools were available for assessment of what a learner does when functioning independently at the clinical workplace (Miller ). Since then portfolios have filled this gap and found their way into medical education, not only as tools for assessment of performance in the workplace, but also as tools to stimulate learning from experience. We give an overview of the content and structure of various types of portfolios, describe the potential of electronic portfolios, present techniques and strategies for using portfolios as tools for stimulating learning and for assessment, and discuss factors that influence the success of the introduction. We conclude that portfolios have a lot of potential but that their introduction also often leads to disappointment, because they require a new perspective on education from mentors and learners and a significant investment of time and energy.

[1]  A. Haig,et al.  The effectiveness of portfolios for post-graduate assessment and education: BEME Guide No 12 , 2009, Medical teacher.

[2]  J. V. van Merriënboer,et al.  The Boundary Approach of Competence: A Constructivist Aid for Understanding and Using the Concept of Competence , 2002 .

[3]  E. Guba,et al.  Fourth Generation Evaluation , 1989 .

[4]  V. Shute.  Focus on Formative Feedback , 2008 .

[5]  Diana H. J. M. Dolmans,et al.  Using a conceptual framework and the opinions of portfolio experts to develop a teaching portfolio prototype , 2004 .

[6]  Diana H. J. M. Dolmans,et al.  Quality issues in judging portfolios: implications for organizing teaching portfolio assessment procedures , 2005 .

[7]  N. Frederiksen.  The real test bias: Influences of testing on teaching and learning. , 1984 .

[8]  Phil Nanlohy,et al.  Digital portfolios: fact or fashion? , 2004 .

[9]  J. Norcini,et al.  Workplace-based assessment as an educational tool: AMEE Guide No. 31 , 2007, Medical teacher.

[10]  D. Nestel,et al.  An e‐portfolio in health professional education , 2004, Medical education.

[11]  M. Fung,et al.  An Internet‐based learning portfolio in resident education: the KOALA™ multicentre programme , 2000, Medical education.

[12]  P. Ven,et al.  One teacher's identity, emotions, and commitment to change: A case study into the cognitive–affective processes of a secondary school teacher in the context of reforms , 2005 .

[13]  F. Paulson.  What Makes a Portfolio a Portfolio , 1991 .

[14]  R. Harden,et al.  Portfolios as a method of student assessment , 2001 .

[15]  Roar Maagaard,et al.  Using an online portfolio in postgraduate training , 2006, Medical teacher.

[16]  Assess students: an overview. , 1979, Medical teacher.

[17]  D Snadden.  Portfolios – attempting to measure the unmeasurable? , 1999, Medical education.

[18]  J. Ker,et al.  Student perceptions of a portfolio assessment process , 2009, Medical education.

[19]  K. A. Ericsson,et al.  The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance , 2006 .

[20]  M. Manen.  Linking Ways of Knowing with Ways of Being Practical , 1977 .

[21]  David Snadden Mary Thomas,et al.  The use of portfolio learning in medical education , 1998 .

[22]  R. Henry,et al.  Curricular Change in Medical Schools: How to Succeed , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[23]  B. Malen.  9. The micropolitics of education: mapping the multiple dimensions of power relations in school polities , 1994 .

[24]  T. Dornan,et al.  The self critical doctor: helping students become more reflective , 2008, BMJ : British Medical Journal.

[25]  Paul Kinnersley,et al.  Exploring students' perceptions on the use of significant event analysis, as part of a portfolio assessment process in general practice, as a tool for learning how to use reflection in learning , 2007, BMC medical education.

[26]  V. Shute.  Focus on Formative Feedback , 2007 .

[27]  N. Redfern,et al.  Revalidating doctors - Ensuring standards, securing the future , 2001 .

[28]  Ann L. Brown,et al.  How people learn: Brain, mind, experience, and school. , 1999 .

[29]  Fred A. J. Korthagen,et al.  Linking Theory and Practice: Changing the Pedagogy of Teacher Education , 1999 .

[30]  Yvonna S. Lincoln,et al.  Fourth generation evaluation Sage. , 1993 .

[31]  S. Dreyfus.  The Five-Stage Model of Adult Skill Acquisition , 2004 .

[32]  L. Darling-Hammond,et al.  The New Handbook of Teacher Evaluation: Assessing Elementary and Secondary School Teachers , 1989 .

[33]  G. F. Abercrombie,et al.  College of General Practitioners , 1954 .

[34]  Cees P M van der Vleuten,et al.  Participants' opinions on the usefulness of a teaching portfolio , 2006, Medical education.

[35]  A. Parry.  Handbook of Qualitative Research , 2002 .

[36]  H. Saedon,et al.  Workplace-based assessment as an educational tool . , 2022 .

[37]  S. Danziger,et al.  Securing the Future , 2000 .

[38]  Paul J. Feltovich,et al.  The Cambridge handbook of expertise and expert performance , 2006 .

[39]  J. Bransford,et al.  Preparing Teachers for a Changing World: What Teachers Should Learn and Be Able to Do. , 2005 .

[40]  J. Tartwijk,et al.  Using an analogy in the introduction of a portfolio , 2008 .

[41]  N. Hatton,et al.  Reflection in teacher education: Towards definition and implementation , 1995 .

[42]  Cees P M van der Vleuten,et al.  Use of portfolios in early undergraduate medical training , 2003, Medical teacher.

[43]  Angelo Collins,et al.  Portfolios for biology teacher assessment , 1991 .

[44]  Rebecca S. Anderson,et al.  Portfolio Use in Twenty-Four Teacher Education Programs. , 1998 .

[45]  M. Conlon.  Appraisal: the catalyst of personal development , 2003, BMJ : British Medical Journal.

[46]  I G Finlay,et al.  A randomized controlled study of portfolio learning in undergraduate cancer education , 1998, Medical education.

[47]  N. Denzin.  Sociological Methods: A Sourcebook , 1978 .

[48]  J. C. Meakins,et al.  The Royal College of Physicians and Surgeons of Canada , 1936, Canadian Medical Association journal.

[49]  Cees P M van der Vleuten,et al.  Conditions for successful reflective use of portfolios in undergraduate medical education , 2005, Medical education.

[50]  David Hopkins,et al.  International Handbook of Educational Change , 2007 .

[51]  Val Wass,et al.  Portfolios in medical education: why do they meet with mixed success? A systematic review , 2007, Medical education.

[52]  Diana H. J. M. Dolmans,et al.  The need for evidence in education , 2000 .

[53]  London,et al.  General Medical Council , 1920 .

[54]  N. Denzin,et al.  Handbook of Qualitative Research , 1994 .

[55]  G. Miller.  The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[56]  Mark D. Reckase,et al.  Demonstration of Portfolios to Assess Competency of Residents , 2004, Advances in health sciences education : theory and practice.

[57]  G. Norman.  Editorial – What's the Active Ingredient in Active Learning? , 2004, Advances in health sciences education : theory and practice.

[58]  Gustavo Duque,et al.  Learning while evaluating: the use of an electronic evaluation portfolio in a geriatric medicine clerkship , 2006, BMC medical education.

[59]  P. Heywood,et al.  Portfolio use in general practice vocational training: a survey of GP registrars , 2004, Medical education.

[60]  C. Popovic,et al.  The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11 , 2009, Medical teacher.

[61]  James W. Smither,et al.  CAN WORKING WITH AN EXECUTIVE COACH IMPROVE MULTISOURCE FEEDBACK RATINGS OVER TIME? A QUASI‐EXPERIMENTAL FIELD STUDY , 2003 .

[62]  Tim Dornan,et al.  An electronic learning portfolio for reflective continuing professional development , 2002, Medical education.

[63]  N. Lyons,et al.  With Portfolio in Hand: Validating the New Teacher Professionalism , 1998 .

[64]  David Gibson,et al.  Directions in Electronic Portfolio Development , 2003 .

[65]  K. Trigwell,et al.  Variation in the Experience of Leadership of Teaching in Higher Education , 2003 .

[66]  A. Hargreaves,et al.  The Seven Principles of Sustainable Leadership. , 2004 .

[67]  M. Friedman Ben David,et al.  AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment , 2001, Medical teacher.

[68]  M. Oermann.  Developing a professional portfolio in nursing. , 2002, Orthopedic nursing.

[69]  Glenn Regehr,et al.  "I'll never play professional football" and other fallacies of self-assessment. , 2008, The Journal of continuing education in the health professions.

[70]  Jana Chocholatá.  How Teachers Learn and Develop , 2011 .

[71]  Michael Fordis,et al.  Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. , 2006, JAMA.

[72]  Jon Snyder,et al.  The Inherent Tensions in the Multiple Uses of Portfolios in Teacher Education. , 1998 .

[73]  C W JEANES,et al.  The royal college of physicians and surgeons of Canada , 1964, Canadian Medical Association journal.

[74]  Eugene Dinkevich,et al.  Bmc Medical Education Effect of a Brief Intervention on Evidence-based Medicine Skills of Pediatric Residents , 2022 .

[75]  Vicki Spandel,et al.  Reflections on Portfolios , 1997 .

[76]  Erik Driessen,et al.  Factors Influencing the Successful Introduction of Portfolios , 2007 .

[77]  Tom Bird,et al.  The Schoolteacher's Portfolio: An Essay on Possibilities , 1990 .

[78]  M.H. Davis,et al.  Portfolio assessment in medical students' final examinations , 2001, Medical teacher.

[79]  A. Muijtjens,et al.  Web‐ or paper‐based portfolios: is there a difference? , 2007, Medical education.

[80]  D Snadden,et al.  Portfolio learning in general practice vocational training – does it work? , 1998, Medical education.

[81]  N. Denzin,et al.  The discipline and practice of qualitative research [Introduction]. Denzin & Y. S. Lincoln (Eds.), The handbook of qualitative research (2nd ed. , 2000 .

[82]  N. Lyons,et al.  Reflection in Teaching: Can it Be Developmental? A Portfolio Perspective. , 1998 .

[83]  J van Tartwijk,et al.  The use of qualitative research criteria for portfolio assessment as an alternative to reliability evaluation: a case study , 2005, Medical education.

[84]  N. Mathers,et al.  Portfolios in continuing medical education – effective and efficient? , 1999, Medical education.

[85]  Christine Webb,et al.  Evaluating portfolio assessment systems: what are the appropriate criteria? , 2003, Nurse education today.

[86]  K. Mann,et al.  Reflection and reflective practice in health professions education: a systematic review , 2009, Advances in health sciences education : theory and practice.

[87]  Gary D. Phye,et al.  Handbook of Academic Learning: Construction of Knowledge , 1997 .

[88]  C. V. D. van der Vleuten,et al.  Matching Student Assessment to Problem-based Learning: Lessons from experience in a law faculty , 2000 .