Theoretical considerations on programmatic assessment

Abstract Introduction: Programmatic assessment (PA) is an approach to assessment aimed at optimizing learning which continues to gain educational momentum. However, the theoretical underpinnings of PA have not been clearly described. An explanation of the theoretical underpinnings of PA will allow educators to gain a better understanding of this approach and, perhaps, facilitate its use and effective implementation. The purpose of this article is twofold: first, to describe salient theoretical perspectives on PA; second to examine how theory may help educators to develop effective PA programs, helping to overcome challenges around PA. Results: We outline a number of learning theories that underpin key educational principles of PA: constructivist and social constructivist theory supporting meaning making, and longitudinality; cognitivist and cognitive development orientation scaffolding the practice of a continuous feedback process; theory of instructional design underpinning assessment as learning; self-determination theory (SDT), self-regulation learning theory (SRL), and principles of deliberate practice providing theoretical tenets for student agency and accountability. Conclusion: The construction of a plausible and coherent link between key educational principles of PA and learning theories should enable educators to pose new and important inquiries, reflect on their assessment practices and help overcome future challenges in the development and implementation of PA in their programs.

[1]  B. Skinner Is it behaviorism? , 1986, Behavioral and Brain Sciences.

[2]  N. van Dijk,et al.  Self‐regulated learning in the clinical context: a systematic review , 2018, Medical education.

[3]  E. Deci,et al.  Handbook of Self-Determination Research , 2002 .

[4]  C. V. D. van der Vleuten,et al.  Assessing professional competence : from methods to programmes , 2005 .

[5]  David P. Ausubel,et al.  The Acquisition and Retention of Knowledge: A Cognitive View , 2000 .

[6]  K. Lewin,et al.  Field Theory in Social Science: Selected Theoretical Papers , 1951 .

[7]  John M. Keller,et al.  Principles of instructional design, 5th edition , 2005 .

[8]  A. Bakker,et al.  Job Demands–Resources Theory: Taking Stock and Looking Forward , 2017, Journal of occupational health psychology.

[9]  R. Feuerstein,et al.  The Dynamic Assessment of Cognitive Modi®ability. The Learning Propensity Assessment Device: Theory, Instruments and Techniques , 2004 .

[10]  T. Guskey Mastery learning: Applying the theory , 1980 .

[11]  T. Wilkinson,et al.  Student progress decision-making in programmatic assessment: can we extrapolate from clinical decision-making and jury decision-making? , 2019, BMC Medical Education.

[12]  C. V. D. van der Vleuten,et al.  Programmatic assessment: From assessment of learning to assessment for learning , 2011, Medical teacher.

[13]  C. Vleuten Programmatic assessment: From assessment of learning to assessment for learning , 2011 .

[14]  B. Zimmerman Developing self-fulfilling cycles of academic regulation: An analysis of exemplary instructional models. , 1998 .

[15]  Christopher J. Harrison,et al.  Factors influencing students’ receptivity to formative feedback emerging from different assessment cultures , 2016, Perspectives on medical education.

[16]  K. A. Ericsson,et al.  Deliberate practice and acquisition of expert performance: a general overview. , 2008, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[17]  Christopher J. Harrison,et al.  Changing the culture of assessment: the dominance of the summative assessment paradigm , 2017, BMC medical education.

[18]  C. V. D. van der Vleuten,et al.  A model for programmatic assessment fit for purpose , 2012, Medical teacher.

[19]  A. Bandura Social cognitive theory: an agentic perspective. , 1999, Annual review of psychology.

[20]  Dario M Torre,et al.  Overview of current learning theories for medical educators. , 2006, The American journal of medicine.

[21]  A. Olupeliyawa,et al.  The impact of programmatic assessment on student learning: what can the students tell us? , 2015, Medical education.

[22]  J. Biggs Enhancing teaching through constructive alignment , 1996 .

[23]  A. Muijtjens,et al.  Workplace-based assessment: effects of rater expertise , 2010, Advances in health sciences education : theory and practice.

[24]  T. Wilkinson,et al.  Joining the dots: Conditional pass and programmatic assessment enhances recognition of problems with professionalism and factors hampering student progress , 2011, BMC medical education.

[25]  L. Schuwirth Making the horse drink: use of mini-CEX in an assessment for learning view , 2013, Advances in health sciences education : theory and practice.

[26]  Theory Development and Application in Medical Education , 2013, Teaching and learning in medicine.

[27]  Chris Roberts,et al.  The reliability and validity of a portfolio designed as a programmatic assessment of performance in an integrated clinical placement , 2014, BMC Medical Education.

[28]  J. Bruner Actual minds, possible worlds , 1985 .

[29]  D. Schunk Self-Regulated Learning: The Educational Legacy of Paul R. Pintrich , 2005 .

[30]  G R Norman,et al.  Exploring the etiology of content specificity: factors influencing analogic transfer and problem solving. , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[31]  P. Pintrich A Conceptual Framework for Assessing Motivation and Self-Regulated Learning in College Students , 2004 .

[32]  W. James Popham,et al.  Assessment Literacy for Teachers: Faddish or Fundamental? , 2009 .

[33]  S. Vosniadou Capturing and modeling the process of conceptual change. , 1994 .

[34]  Paul A. Kirschner,et al.  Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design , 2007 .

[35]  J. Mezirow Transformative Learning: Theory to Practice. , 1997 .

[36]  Lorelei Lingard,et al.  Reading between the lines: faculty interpretations of narrative evaluation comments , 2015, Medical education.

[37]  C. V. D. van der Vleuten,et al.  Programmatic assessment of competency-based workplace learning: when theory meets practice , 2013, BMC Medical Education.

[38]  C. Palermo,et al.  Designing programmes of assessment: A participatory approach , 2017, Medical teacher.

[39]  Robert Sommer,et al.  Experience and Education. , 1974 .

[40]  L. Schuwirth,et al.  Identifying the narrative used by educators in articulating judgement of performance , 2019, Perspectives on medical education.

[41]  A. Muijtjens,et al.  Workplace-based assessment: raters’ performance theories and constructs , 2012, Advances in Health Sciences Education.

[42]  A. Muijtjens,et al.  Embedding of the progress test in an assessment program designed according to the principles of programmatic assessment , 2017, Medical teacher.

[43]  Scott R. Rosas,et al.  Systems thinking and complexity: considerations for health promoting schools , 2015, Health promotion international.

[44]  Leslie J. Briggs,et al.  Principles of Instructional Design , 1974 .

[45]  A. M. White The Process of Education , 1994 .

[46]  M. Smith Field Theory in Social Science: Selected Theoretical Papers. , 1951 .

[47]  James H. Block Promoting excellence through mastery learning , 1980 .

[48]  R. Hatala,et al.  When Assessment Data Are Words: Validity Evidence for Qualitative Educational Assessments , 2016, Academic medicine : journal of the Association of American Medical Colleges.

[49]  M. Cole,et al.  Mind in society: The development of higher psychological processes. L. S. Vygotsky. , 1978 .

[50]  Wayne F. Velicer,et al.  Evaluating Theories of Health Behavior Change: A Hierarchy of Criteria Applied to the Transtheoretical Model , 2008 .

[51]  K. Eva,et al.  Cracking the code: residents’ interpretations of written assessment comments , 2017, Medical education.

[52]  Cees P M van der Vleuten,et al.  The use of programmatic assessment in the clinical workplace: A Maastricht case report , 2012, Medical teacher.

[53]  L. Schuwirth,et al.  An application of programmatic assessment for learning (PAL) system for general practice training , 2017, GMS journal for medical education.