Educational Technologies for Physician Continuous Professional Development: A National Survey

Purpose To determine the past experiences with, current use of, and anticipated use of online learning and simulation-based education among practicing U.S. physicians, and how findings vary by age. Method The authors surveyed 4,648 randomly sampled board-certified U.S. physicians, September 2015 to April 2016, using Internet-based and paper questionnaires. Survey items (some optional) addressed past and current technology usage, perceived technology effectiveness, and anticipated future use of specific technology innovations. Results Of 988 respondents, 444 completed optional items. Of these, 429/442 (97.1%) had used online learning and 372/442 (84.2%) had used simulation-based education in the past five years. Desire for more online learning was modest (mean [standard deviation], 4.6 [1.5]; 1 = strongly disagree, 7 = strongly agree), as was desire for more simulation-based education (4.2 [1.7]). Both online learning and simulation-based education were perceived as effective (5.2 [1.4]; 5.0 [1.4]). Physicians believed they possess adequate skills for online learning (5.8 [1.2]) and that point-of-care learning is vital to effective patient care (5.3 [1.3]). Only 39.0% used objective performance data to guide their learning choices, although 64.6% agreed that such information would be useful. The highest-rated innovations included a central repository for listing educational opportunities and tracking continuing education credits, an app to award credit for answering patient-focused questions, 5-minute and 20-minute clinical updates, and an e-mailed “question of the week.” Responses to most survey items were similar across age groups. Conclusions Practicing physicians generally seem receptive and prepared to use a variety of educational technologies, regardless of age.

[1]  Trends in Physician Preferences for and Use of Sources of Medical Information in Response to Questions Arising at the Point of Care: 2009–2013 , 2014, The Journal of continuing education in the health professions.

[2]  Guilherme Del Fiol,et al.  A large-scale knowledge management method based on the analysis of the use of online knowledge resources. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[3]  Diane Heestand,et al.  Educational Technology Infrastructure and Services in North American Medical Schools , 2006, Academic medicine : journal of the Association of American Medical Colleges.

[4]  Nancy L Wilczynski,et al.  The quality, breadth, and timeliness of content updating vary substantially for 10 online medical texts: an analytic survey. , 2012, Journal of clinical epidemiology.

[5]  Jill Steinbruegge,et al.  Results of the First National Kaiser Permanente Continuing Medical Education Needs Assessment Survey. , 2002, The Permanente journal.

[6]  David A. Cook,et al.  Features of Effective Medical Knowledge Resources to Support Point of Care Learning: A Focus Group Study , 2013, PloS one.

[7]  Spencer S. Jones,et al.  Health Information Technology: An Updated Systematic Review With a Focus on Meaningful Use , 2014, Annals of Internal Medicine.

[8]  M. Rieger,et al.  German ambulatory care physicians' perspectives on continuing medical education—A national survey , 2009, The Journal of continuing education in the health professions.

[9]  David A Cook,et al.  Professional Development Perceptions and Practices Among U.S. Physicians: A Cross-Specialty National Survey , 2017, Academic medicine : journal of the Association of American Medical Colleges.

[10]  Kevin W Eva,et al.  Towards a program of assessment for health professionals: from training into practice , 2016, Advances in health sciences education : theory and practice.

[11]  M. Roizen,et al.  Technology-enhanced simulation for health professions education: a systematic review and meta-analysis , 2012 .

[12]  P. Arn,et al.  Education format and resource preferences among registrants of a pediatric-focused CME website , 2009, Medical teacher.

[13]  David A Cook,et al.  Evaluating technology-enhanced learning: A comprehensive framework , 2015, Medical teacher.

[14]  Robert Kristofco,et al.  Physician internet medical information seeking and on‐line continuing education use patterns , 2002, The Journal of continuing education in the health professions.

[15]  K. Masters,et al.  AMEE Guide 32: e-Learning in medical education Part 1: Learning, teaching and assessment , 2008, Medical teacher.

[16]  David A Cook,et al.  Comparative Effectiveness of Technology-Enhanced Simulation Versus Other Instructional Methods: A Systematic Review and Meta-Analysis , 2012, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[17]  David A. Cook,et al.  Information needs of generalists and specialists using online best-practice algorithms to answer clinical questions , 2017, J. Am. Medical Informatics Assoc..

[18]  David A Cook,et al.  Technology-Enhanced Simulation to Assess Health Professionals: A Systematic Review of Validity Evidence, Research Methods, and Reporting Quality , 2013, Academic medicine : journal of the Association of American Medical Colleges.

[19]  Julie Kim,et al.  Physician Preferences for Accredited Online Continuing Medical Education , 2011, The Journal of continuing education in the health professions.

[20]  K. Ho,et al.  Interactive on‐line continuing medical education: Physicians' perceptions and experiences , 2004, The Journal of continuing education in the health professions.

[21]  Suzanne Austin Boren,et al.  eLearning: A review of Internet‐based continuing medical education , 2004, The Journal of continuing education in the health professions.

[22]  D. Cook,et al.  Internet-based learning in the health professions: a meta-analysis. , 2008, JAMA.

[23]  J. Sargeant,et al.  Practicing physicians' needs for assessment and feedback as part of professional development. , 2013, The Journal of continuing education in the health professions.

[24]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[25]  L. Miller,et al.  Handling Nonresponse Issues. , 1983 .

[26]  Internet point of care learning at a community hospital , 2009, The Journal of continuing education in the health professions.

[27]  P. Gorman,et al.  Clinical questions raised by clinicians at the point of care: a systematic review. , 2014, JAMA internal medicine.

[28]  E. Holmboe Assessment of the practicing physician: challenges and opportunities. , 2008, The Journal of continuing education in the health professions.

[29]  Dean F Sittig,et al.  Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. , 2012, The American journal of medicine.

[30]  David A Cook,et al.  Barriers and decisions when answering clinical questions at the point of care: a grounded theory study. , 2013, JAMA internal medicine.

[31]  Scott L. Zeger,et al.  Factors Associated with Medical Knowledge Acquisition During Internal Medicine Residency , 2007, Journal of General Internal Medicine.

[32]  Bernard M Sklar,et al.  The growth, characteristics, and future of online CME , 2010, The Journal of continuing education in the health professions.

[33]  Glenn Regehr,et al.  "I'll never play professional football" and other fallacies of self-assessment. , 2008, The Journal of continuing education in the health professions.

[34]  Suzanne Bakken,et al.  An automated approach to studying health resource and infobutton use. , 2006, Studies in health technology and informatics.

[35]  David A Cook,et al.  Physician Attitudes About Maintenance of Certification: A Cross-Specialty National Survey. , 2016, Mayo Clinic proceedings.

[36]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[37]  K. Shojania,et al.  The effects of on-screen, point of care computer reminders on processes and outcomes of care. , 2009, The Cochrane database of systematic reviews.