Motivating Learning and Assessing Outcomes in Continuing Medical Education Using a Personal Learning Plan

Introduction: Although there is increasing focus on provider behavior change as an outcome of continuing medical education (CME), it has long been known that an increase in knowledge alone is rarely sufficient to induce such change. The Personal Learning Plan (PLP), designed to motivate and assess CME learning, was partly derived from SMART goals (specific, measurable, attainable, realistic, and timely), a concept well supported as a strategy to promote behavior change. The goal of this study was to explore the relationship between SMART goals developed after attending a CME conference and subsequent provider behavior change, using the PLP as a tool. Methods: PLPs were used as the outcome measure for Dartmouth‐Hitchcock Continuing Medical Education conferences conducted during the fall of 2010. Three months later, participants were asked how close they were to completing their goals. All participants' goals were analyzed according to SMART criteria. Results: Of the 841 participants attending conferences in fall 2010, 347 completed a PLP. An independent t‐test found that among the 125 participants who completed the follow‐up survey, those who indicated that they had completed their goal or were “very close” or “extremely close” to completing their goal wrote SMARTer goals than those who reported being “not at all close” to “moderately close” to completing their goal (t = 2.48, df = 123, p = 0.015). Discussion: Our results corroborate previous research that has found “use of specific strategies to implement research‐based recommendations seems to be necessary to ensure that practices change.” Future directions include both a study of use of a PLP compared to a simple intent to change document and work on helping participants to write SMARTer goals.

[1]  C. Edmiston,et al.  Accreditation Council for Continuing Medical Education Approves SHEA , 1998, Infection Control & Hospital Epidemiology.

[2]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[3]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[4]  M. Cabana,et al.  Why don't physicians follow clinical practice guidelines? A framework for improvement. , 1999, JAMA.

[5]  J L Dolcourt,et al.  Commitment to change: A strategy for promoting educational effectiveness , 2000, The Journal of continuing education in the health professions.

[6]  M. Challis AMEE Medical Education Guide No. 19: Personal learning plans , 2000 .

[7]  Lyman W. Porter,et al.  The role of task-goal attributes in employee performance. , 1974 .

[8]  I. Ajzen The theory of planned behavior , 1991 .

[9]  I. Purkis Commitment for changes: an instrument for evaluating CME courses. , 1982, Journal of medical education.

[10]  E. Nelson,et al.  Quality By Design: A Clinical Microsystems Approach , 2010 .

[11]  Terence R. Mitchell,et al.  Importance of participative goal setting and anticipated rewards on goal difficulty and job performance. , 1978 .

[12]  Alexander K. Koch,et al.  Self-Regulation Through Goal Setting , 2011, SSRN Electronic Journal.

[13]  P. Gollwitzer,et al.  Implementation intentions and goal achievement: A meta-analysis of effects and processes , 2006 .

[14]  Edwin A. Locke,et al.  The Determinants of Goal Commitment , 1988 .

[15]  Michel Wensing,et al.  What drives change? Barriers to and incentives for achieving evidence‐based practice , 2004, The Medical journal of Australia.

[16]  J. Wakefield,et al.  Commitment to change: exploring its role in changing physician behavior through continuing education. , 2004, The Journal of continuing education in the health professions.

[17]  F. Sniehotta,et al.  Towards a theory of intentional behaviour change: plans, planning, and self-regulation. , 2009, British journal of health psychology.

[18]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[19]  T. Osberg,et al.  The Relative Accuracy of Self-Predictions and Judgments by Others in Psychological Assessment , 1981 .

[20]  P. Mazmanian,et al.  Commitment to change: Theoretical foundations, methods, and outcomes , 1999 .

[21]  Alanna Kulchak Rahm,et al.  Assessment of barriers to changing practice as CME outcomes* , 2010, The Journal of continuing education in the health professions.

[22]  W. Velicer,et al.  The Transtheoretical Model of Health Behavior Change , 1997, American journal of health promotion : AJHP.

[23]  Christina Rudy Smith The National Archives and Records Administration , 1989 .

[24]  E. A. Locke,et al.  Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. , 2002, The American psychologist.

[25]  W. Miller,et al.  Motivational Interviewing with Problem Drinkers , 1983, Behavioural Psychotherapy.

[26]  Jeremy M Grimshaw,et al.  Changing physicians' behavior: what works and thoughts on getting more things to work. , 2002, The Journal of continuing education in the health professions.

[27]  P. Ackerman,et al.  Cognitive, perceptual-speed, and psychomotor determinants of individual differences during skill acquisition. , 2000, Journal of experimental psychology. Applied.

[28]  L W Green,et al.  Preventive practices by physicians: behavioral determinants and potential interventions. , 1988, American journal of preventive medicine.

[29]  I. Ajzen,et al.  Belief, Attitude, Intention, and Behavior: An Introduction to Theory and Research , 1977 .

[30]  J Lomas,et al.  Evidence of self-report bias in assessing adherence to guidelines. , 1999, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[31]  R. Koestner,et al.  Attaining personal goals: self-concordance plus implementation intentions equals success. , 2002, Journal of personality and social psychology.

[32]  P. Mazmanian,et al.  Information about barriers to planned change: a randomized controlled trial involving continuing medical education lectures and commitment to change , 1998, Academic medicine : journal of the Association of American Medical Colleges.

[33]  Gary P. Latham,et al.  Goal Setting:: A Five-Step Approach to Behavior Change , 2003 .

[34]  Kristen R. Stephens,et al.  Learning by Doing: A Handbook for Professional Learning Communities at Work , 2009 .

[35]  R. Grol Implementing guidelines in general practice care. , 1992, Quality in health care : QHC.

[36]  A. Bandura,et al.  Self-evaluative and self-efficacy mechanisms governing the motivational effects of goal systems. , 1983 .

[37]  S. Dabbo,et al.  Motivational Interviewing: Preparing People to Change Addictive Behavior , 1993 .

[38]  J. T. Austin,et al.  Goal constructs in psychology: Structure, process, and content. , 1996 .

[39]  H. Gallis,et al.  Achieving desired results and improved outcomes: Integrating planning and assessment throughout learning activities , 2009, The Journal of continuing education in the health professions.

[40]  A. Bandura Social cognitive theory: an agentic perspective. , 1999, Annual review of psychology.

[41]  S. Straus,et al.  Learning in practice The case for knowledge translation : shortening the journey from evidence to effect , 2003 .

[42]  C. Mulrow,et al.  From understanding health care provider behavior to improving health care: the QUERI framework for quality improvement. Quality Enhancement Research Initiative. , 2000, Medical care.

[43]  Henry L. Tosi A Theory of Goal Setting and Task Performance , 1991 .

[44]  Andrew D Oxman,et al.  Closing the gap between research and practice : an overview of systematic reviews of interventions to promote the implementation of research findings , 2011 .

[45]  Robert S. Rubin,et al.  Will the Real SMART Goals Please Stand Up , 2002 .

[46]  D. Schunk Goal Setting and Self-Efficacy During Self-Regulated Learning , 1990 .

[47]  R. Macvicar,et al.  Requesting a commitment to change: conditions that produce behavioral or attitudinal commitment. , 2008, The Journal of continuing education in the health professions.

[48]  A. Bandura Social Foundations of Thought and Action: A Social Cognitive Theory , 1985 .

[49]  P. Mazmanian,et al.  Anticipated and encountered barriers to change in CME: Tools for planning and evaluation , 1991 .