Toward Meeting the Challenge of Physician Competence Assessment: The University of California, San Diego Physician Assessment and Clinical Education (PACE) Program

Physician competence and performance problems contribute to medical errors and substandard health care quality. Assessment of the clinical competence of practicing physicians, however, is challenging. Although physician competence assessment undoubtedly does take place at the local level (e.g., hospital, medical group), it is difficult to objectively assess a partner, colleague, or friend. Moreover, the methodologies used and the outcomes are necessarily veiled by peer review statutes. Consequently, there is a need for regional or national assessment centers with the knowledge, skill, and experience to perform clinical competence assessments on individual physicians and provide or direct remediation, when appropriate. The University of California, San Diego (UCSD) Physician Assessment and Clinical Education (PACE) Program was founded at the UCSD School of Medicine in 1996 for this purpose. From inception in 1996 through the first quarter of 2009, 867 physicians have participated in the UCSD PACE Program. The PACE Program is divided into two components. Phase I includes two days of multilevel, multimodal testing, and Phase II is a five-day, preceptor-based formative assessment program taking place in the residency program of the physician's specialty. From July 2002 through December 2005, a study of 298 physician participants of the UCSD PACE Program was conducted. The future of the comprehensive assessment of practicing physicians depends on (1) development and standardization of instruments, techniques, and procedures for measuring competence and performance, including in-practice measures, (2) collaborative networking of assessment programs, (3) cost control, and (4) continued development of remedial measures that correspond to assessment findings.

[1]  D. Irby,et al.  Assessment in medical education. , 2007, The New England journal of medicine.

[2]  Michael Fordis,et al.  Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. , 2006, JAMA.

[3]  J. Puffer,et al.  Maintenance of certification for family physicians (MC-FP) self assessment modules (SAMs): the first year. , 2006, Journal of the American Board of Family Medicine : JABFM.

[4]  L. Leape,et al.  Problem Doctors: Is There a System-Level Solution? , 2006, Annals of Internal Medicine.

[5]  E. Wenghofer,et al.  Effectiveness of an enhanced peer assessment program: Introducing education into regulatory assessment , 2006, The Journal of continuing education in the health professions.

[6]  B. Williams The prevalence and special educational requirements of dyscompetent physicians , 2006, The Journal of continuing education in the health professions.

[7]  C. Cassel,et al.  Who Is Maintaining Certification in Internal Medicineand Why? A National Survey 10 Years after Initial Certification , 2006, Annals of Internal Medicine.

[8]  M. Abrahamowicz,et al.  Effect of a community oriented problem based learning curriculum on quality of primary care delivered by graduates: historical cohort comparison study , 2005, BMJ : British Medical Journal.

[9]  Kevin W Eva,et al.  Self-Assessment in the Health Professions: A Reformulation and Research Agenda , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[10]  J. Norcini Current perspectives in assessment: the assessment of performance at work , 2005, Medical education.

[11]  H. Dimassi,et al.  Disciplinary action against physicians: who is likely to get disciplined? , 2005, The American journal of medicine.

[12]  Regina M. Benjamin,et al.  Obstacles to maintaining licensure in the United States , 2005, BMJ : British Medical Journal.

[13]  E. Alden,et al.  Accreditation for learning and change: Quality and improvement as the outcome , 2005, The Journal of continuing education in the health professions.

[14]  T. Swanwick,et al.  Workplace assessment for licensing in general practice. , 2005, The British journal of general practice : the journal of the Royal College of General Practitioners.

[15]  F. Goulet,et al.  An Innovative Approach to Remedial Continuing Medical Education, 1992–2002 , 2005, Academic medicine : journal of the Association of American Medical Colleges.

[16]  D. Melnick Physician performance and assessment and their effect on continuing medical education and continuing professional development. , 2004, The Journal of continuing education in the health professions.

[17]  L. Ross,et al.  Characteristics associated with physician discipline: a case-control study. , 2004, Archives of internal medicine.

[18]  P. McAvoy,et al.  Assessing the competence of practicing physicians in New Zealand, Canada, and the United Kingdom: progress and problems. , 2004, Family medicine.

[19]  Sharon-Lise T Normand,et al.  Physician clinical performance assessment: prospects and barriers. , 2003, JAMA.

[20]  P. Finucane,et al.  A Comparison of Performance Assessment Programs for Medical Practitioners in Canada, Australia, New Zealand, and the United Kingdom , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[21]  SW Clay,et al.  Characteristics of physicians disciplined by the State Medical Board of Ohio , 2003, The Journal of the American Osteopathic Association.

[22]  Robyn Tamblyn,et al.  Association between licensure examination scores and practice in primary care. , 2002, JAMA.

[23]  Eric Schneider,et al.  Views of practicing physicians and the public on medical errors. , 2002, The New England journal of medicine.

[24]  L. Leape,et al.  A series on patient safety. , 2002, The New England journal of medicine.

[25]  M. Barón-Maldonado,et al.  Procedures for establishing defensible programmes for assessing practice performance , 2002, Medical education.

[26]  J. Rethans,et al.  The relationship between competence and performance: implications for assessing practice performance , 2002, Medical education.

[27]  D. Asch,et al.  Conceptual challenges in tailoring physician performance assessment to individual practice , 2002, Medical education.

[28]  I C McManus,et al.  Linking assessment to learning: a new route to quality assurance in medical practice , 2002, Medical education.

[29]  L W T Schuwirth,et al.  When enough is enough: a conceptual basis for fair and defensible practice performance assessment , 2002, Medical education.

[30]  J. Gupta,et al.  Reentry into clinical practice: challenges and strategies. , 2002, JAMA.

[31]  E. Hundert,et al.  Defining and assessing professional competence. , 2002, JAMA.

[32]  B Jolly,et al.  The assessment of poorly performing doctors: the development of the assessment programmes for the General Medical Council’s Performance Procedures , 2001, Medical education.

[33]  P. Wickersham,et al.  Physicians disciplined by a state medical board. , 1998, JAMA.

[34]  L. Nixon strangers in good company , 1997 .

[35]  Geoffrey R. Norman,et al.  The effect of presentation order in clinical decision making. , 1997 .

[36]  E. Hanna,et al.  Defensible assessment of the competency of the practicing physician , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[37]  G. Bordage,et al.  Physician-assessment and physician-enhancement programs in Canada. , 1995, The International journal of risk & safety in medicine.

[38]  E. Hanna,et al.  Competency assessment of primary care physicians as part of a peer review program. , 1993, JAMA.

[39]  K. Parakh Assessment in medical education. , 2007, The New England journal of medicine.

[40]  R. Cardarelli,et al.  Predicting risk for disciplinary action by a state medical board. , 2004, Texas medicine.

[41]  L. Barozzi,et al.  Medical Professionalism in the New Millennium: A Physician Charter , 2002, Annals of Internal Medicine.

[42]  Alberto Malliani,et al.  Medical professionalism in the new millennium: a physician charter. , 2002, Annals of internal medicine.

[43]  William R. Hendee,et al.  To Err is Human: Building a Safer Health System , 2001 .

[44]  M. Herkov,et al.  Remedial education: can this doctor be saved? , 2000, Transactions of the American Clinical and Climatological Association.

[45]  Fielding Sl When patients feel ignored: study findings about medical liability. , 1997 .

[46]  ROYAL COLLEGE OF PHYSICIANS AND SURGEONS OF CANADA. , 1930, Canadian Medical Association journal.