Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities.

CONTEXT Poor patient-physician communication increases the risk of patient complaints and malpractice claims. To address this problem, licensure assessment has been reformed in Canada and the United States, including a national standardized assessment of patient-physician communication and clinical history taking and examination skills. OBJECTIVE To assess whether patient-physician communication examination scores in the clinical skills examination predicted future complaints in medical practice. DESIGN, SETTING, AND PARTICIPANTS Cohort study of all 3424 physicians taking the Medical Council of Canada clinical skills examination between 1993 and 1996 who were licensed to practice in Ontario and/or Quebec. Participants were followed up until 2005, including the first 2 to 12 years of practice. MAIN OUTCOME MEASURE Patient complaints against study physicians that were filed with medical regulatory authorities in Ontario or Quebec and retained after investigation. Multivariate Poisson regression was used to estimate the relationship between complaint rate and scores on the clinical skills examination and traditional written examination. Scores are based on a standardized mean (SD) of 500 (100). RESULTS Overall, 1116 complaints were filed for 3424 physicians, and 696 complaints were retained after investigation. Of the physicians, 17.1% had at least 1 retained complaint, of which 81.9% were for communication or quality-of-care problems. Patient-physician communication scores for study physicians ranged from 31 to 723 (mean [SD], 510.9 [91.1]). A 2-SD decrease in communication score was associated with 1.17 more retained complaints per 100 physicians per year (relative risk [RR], 1.38; 95% confidence interval [CI], 1.18-1.61) and 1.20 more communication complaints per 100 practice-years (RR, 1.43; 95% CI, 1.15-1.77). After adjusting for the predictive ability of the clinical decision-making score in the traditional written examination, the patient-physician communication score in the clinical skills examination remained significantly predictive of retained complaints (likelihood ratio test, P < .001), with scores in the bottom quartile explaining an additional 9.2% (95% CI, 4.7%-13.1%) of complaints. CONCLUSION Scores achieved in patient-physician communication and clinical decision making on a national licensing examination predicted complaints to medical regulatory authorities.

[1]  Kevin S. Decker Playing doctor. , 2001, Minnesota medicine.

[2]  J. Stockman Disciplinary Action by Medical Boards and Prior Behavior in Medical School , 2007 .

[3]  J. Beasley,et al.  The state of quality reports: comparing states by their rankings. , 2006, WMJ : official publication of the State Medical Society of Wisconsin.

[4]  A. Teherani,et al.  Disciplinary action by medical boards and prior behavior in medical school. , 2005, The New England journal of medicine.

[5]  Stephen G. Henry A piece of my mind. Playing doctor. , 2005, Journal of the American Medical Association (JAMA).

[6]  E John Orav,et al.  The relation of patient satisfaction with complaints against physicians and malpractice lawsuits. , 2005, The American journal of medicine.

[7]  W. Dauphinee Self regulation must be made to work , 2005, BMJ : British Medical Journal.

[8]  Kevin Fiscella,et al.  Are Patients’ Ratings of Their Physicians Related to Health Outcomes? , 2005, The Annals of Family Medicine.

[9]  Miles Bore,et al.  Assessment of personal qualities in relation to admission to medical school , 2005, Medical education.

[10]  Ronald M Epstein,et al.  Patient Trust: Is It Related to Patient-Centered Behavior of Primary Care Physicians? , 2004, Medical care.

[11]  M. Bogdonoff The clinical-skills examination. , 2004, New England Journal of Medicine.

[12]  Maxine A Papadakis,et al.  The Step 2 clinical-skills examination. , 2004, The New England journal of medicine.

[13]  L. Ross,et al.  Characteristics associated with physician discipline: a case-control study. , 2004, Archives of internal medicine.

[14]  Mark D Schwartz,et al.  Effect of communications training on medical student performance. , 2003, JAMA.

[15]  J. Pichert,et al.  Patient complaints and malpractice risk. , 2002, JAMA.

[16]  J. Hanley A heuristic approach to the formulas for population attributable fraction , 2001, Journal of epidemiology and community health.

[17]  H. Mandin,et al.  Conceptual Guidelines for Developing and Maintaining Curriculum and Examination Objectives: The Experience of the Medical Council of Canada , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[18]  N. Adler,et al.  Medical malpractice: the effect of doctor-patient relations on medical patient perceptions and malpractice intentions. , 2000, The Western journal of medicine.

[19]  E. Halperin Grievances against physicians: 11 years' experience of a medical society grievance committee. , 2000, The Western journal of medicine.

[20]  M. Wilkes,et al.  A Comparative Study of Measures to Evaluate Medical Students' Performances , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[21]  G. Whelan Educational Commission for Foreign Medical Graduates: lessons learned in a high-stakes, high-volume medical performance examination , 2000 .

[22]  Stefan Sperlich,et al.  Generalized Additive Models , 2014 .

[23]  Ben‐David,et al.  The performance of foreign medical graduates on the National Board of Medical Examiners (NBME) standardized patient examination prototype: a collaborative study of the NBME and the educational Commission for Foreign Medical Graduates (ECFMG) , 1999, Medical education.

[24]  J P Mullooly,et al.  Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons. , 1997, JAMA.

[25]  R. Bovbjerg,et al.  The relationship between physicians' malpractice claims history and later claims: does the past predict the future? , 1994, Journal of the Mississippi State Medical Association.

[26]  R. Reznick,et al.  Optimizing the Input of Physician Examiners in Setting Standards for a Large Scale OSCE: Experience with Part II of the Qualifying Examination of the Medical Council of Canada , 1997 .

[27]  E. Clayton,et al.  Development of an Early Identification and Response Model of Malpractice Prevention , 1997 .

[28]  R. Reznick,et al.  Large‐scale high‐stakes testing with an OSCE: report from the Medical Council of Canada , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[29]  E. Clayton,et al.  Obstetricians' Prior Malpractice Experience and Patients' Satisfaction With Care , 1995 .

[30]  G Bordage,et al.  Developing key‐feature problems and examinations to assess clinical decision‐making skills , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[31]  G Bordage,et al.  The Medical Council of Canada's key features project: a more valid written examination of clinical decision‐making skills , 1995, Academic medicine : journal of the Association of American Medical Colleges.

[32]  E. Clayton,et al.  Obstetricians' prior malpractice experience and patients' satisfaction with care. , 1994, JAMA.

[33]  R. Frankel,et al.  The doctor-patient relationship and malpractice. Lessons from plaintiff depositions. , 1994, Archives of internal medicine.

[34]  M. Young,et al.  Why do people sue doctors? A study of patients and relatives taking legal action , 1994, The Lancet.

[35]  F A Sloan,et al.  Factors that prompted families to file medical malpractice claims following perinatal injuries. , 1992, JAMA.

[36]  R. Rosenblatt,et al.  Characteristics of Physicians With Obstetric Malpractice Claims Experience , 1991, Obstetrics and gynecology.

[37]  D. Signorini,et al.  Sample size for Poisson regression , 1991 .

[38]  M. Philbin,et al.  Assessment of clinical skills of residents utilizing standardized patients. A follow-up study and recommendations for application. , 1991, Annals of internal medicine.

[39]  Mahmud Hassan,et al.  Medical malpractice experience of physicians. Predictable or haphazard? , 1989, JAMA.

[40]  Citron Ds A guide to the essentials of a modern medical practice act. , 1986 .

[41]  D. Citron A guide to the essentials of a modern medical practice act. , 1986, Federation bulletin.

[42]  G. William Walster,et al.  Effect of Reliability and Validity on Power of Statistical Tests , 1970 .

[43]  F. C. Zapffe The Association of American Medical Colleges , 1938 .