Evidence within a portfolio-based assessment program: What do medical students select to document their performance?

Background: Decisions about performance in programs of assessment that provide an array of assessment evidence require judgments about the quality of different pieces of assessment data to determine which combination of data points best represent a trainee's overall performance. Aim: In this article, we examine the nature of evidence selected by first-year medical students to include in a portfolio used to make promotion decisions. Methods: We reviewed portfolios to examine the number, type, and source of assessments selected by students (n = 32) to document their performance in seven competencies. The quality of assessment data selected for each competency was rated by promotion committee members (n = 14). Results: Findings indicate that students cited multiple types and sources of available assessments. The promotion committee rated evidence quality highest for competencies where the program provided sufficient evidence for students to cite a broad range of assessments. When assessments were not provided by the program, students cited self-generated evidence. Conclusion: We found that when student-constructed portfolios are part of an overall assessment system, students generally select evidence in proportion to the number and types of assessments available.

[1]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[2]  Daniel Koretz,et al.  Large‐scale Portfolio Assessments in the US: evidence pertaining to the quality of measurement , 1998 .

[3]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[4]  K. Mann,et al.  Exploring family physicians' reactions to multisource feedback: perceptions of credibility and usefulness , 2005, Medical education.

[5]  Enhancing reliability in portfolio assessment: 'shaping' the portfolio , 2001, Medical teacher.

[6]  Judith A. Arter,et al.  Using Portfolios of Student Work in Instruction and Assessment , 2005 .

[7]  G. Norman Are learning portfolios worth the effort? No , 2008, BMJ : British Medical Journal.

[8]  Val Wass,et al.  Portfolios in medical education: why do they meet with mixed success? A systematic review , 2007, Medical education.

[9]  E. Dannefer,et al.  Student perspectives on assessment: Experience in a competency-based portfolio system , 2012, Medical teacher.

[10]  C. V. D. van der Vleuten,et al.  Programmatic assessment: From assessment of learning to assessment for learning , 2011, Medical teacher.

[11]  Elaine F Dannefer,et al.  The portfolio approach to competency-based assessment at the Cleveland Clinic Lerner College of Medicine. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[12]  C. V. D. van der Vleuten,et al.  A model for programmatic assessment fit for purpose , 2012, Medical teacher.

[13]  Chris Roberts,et al.  Portfolio‐based assessments in medical education: are they valid and reliable for summative purposes? , 2002, Medical education.

[14]  S. Leinster Learning in the clinical environment , 2009, Medical teacher.

[15]  C. Vleuten Programmatic assessment: From assessment of learning to assessment for learning , 2011 .

[16]  R. Harden,et al.  Portfolios as a method of student assessment , 2001 .

[17]  L. Henson,et al.  Cleveland Clinic Lerner College of Medicine: an innovative approach to medical education and the training of physician investigators. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[18]  -1 - Amee Medical Education Guide No 20 , 2022 .

[19]  M. Friedman Ben David,et al.  AMEE Medical Education Guide No. 24: Portfolios as a method of student assessment , 2001, Medical teacher.

[20]  Erik W Driessen,et al.  Portfolios for assessment and learning: AMEE Guide no. 45 , 2009, Medical teacher.

[21]  Paul A. Kirschner,et al.  Determining the quality of Competence Assessment Programs: A self-evaluation procedure , 2007 .

[22]  J. Dijkstra,et al.  A new framework for designing programmes of assessment , 2009, Advances in health sciences education : theory and practice.