Factors associated with variability in the assessment of UK doctors’ professionalism: analysis of survey results

Objectives To investigate potential sources of systematic bias arising in the assessment of doctors’ professionalism. Design Linear regression modelling of cross sectional questionnaire survey data. Setting 11 clinical practices in England and Wales. Participants 1065 non-training grade doctors from various clinical specialties and settings, 17 031 of their colleagues, and 30 333 of their patients. Main outcome measures Two measures of a doctor’s professional performance using patient and colleague questionnaires from the United Kingdom’s General Medical Council (GMC). We selected potential predictor variables from the characteristics of the doctors and of their patient and colleague assessors. Results After we adjusted for characteristics of the doctor as well as characteristics of the patient sample, less favourable scores from patient feedback were independently predicted by doctors having obtained their primary medical degree from any non-European country; doctors practising as a psychiatrist; lower proportions of white patients providing feedback; lower proportions of patients rating their consultation as being very important; and lower proportions of patients reporting that they were seeing their usual doctor. Lower scores from colleague feedback were independently predicted by doctors having obtained their primary medical degree from countries outside the UK and South Asia; currently employed in a locum capacity; working as a general practitioner or psychiatrist; being employed in a staff grade, associate specialist, or other equivalent role; and with a lower proportion of colleagues reporting they had daily or weekly professional contact with the doctor. In fully adjusted models, the doctor’s age, sex, and ethnic group were not independent predictors of patient or colleague feedback. Neither the age or sex profiles of the patient or colleague samples were independent predictors of doctors’ feedback scores, and nor was the ethnic group of colleague samples. Conclusions Caution is necessary when considering patient and colleague feedback regarding doctors’ professionalism. Multisource feedback undertaken for revalidation using the GMC patient and colleague questionnaires should, at least initially, be principally formative in nature.

[1]  M. Elliott,et al.  Race/ethnicity, language, and patients' assessments of care in Medicaid managed care. , 2003, Health services research.

[2]  L. Mackillop,et al.  A single generic multi-source feedback tool for revalidation of all UK career-grade doctors: Does one size fit all? , 2011, Medical teacher.

[3]  David Thomas Stern,et al.  Measuring Medical Professionalism , 2005 .

[4]  J. Archer,et al.  Can a district hospital assess its doctors for re‐licensure? , 2008, Medical education.

[5]  A. Dickens,et al.  Assessing the professional performance of UK doctors: an evaluation of the utility of the General Medical Council patient and colleague questionnaires , 2008, Quality & Safety in Health Care.

[6]  Catherine Pope,et al.  Is Fast Access to General Practice all that Should Matter? A Discrete Choice Experiment of Patients’ Preferences , 2008, Journal of health services research & policy.

[7]  R. Lipner,et al.  The Value of Patient and Peer Ratings in Recertification , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[8]  J. Carline,et al.  Use of peer ratings to evaluate physician performance. , 1993, JAMA.

[9]  Tracy M. Maylett 360-Degree Feedback Revisited: The Transition From Development to Appraisal , 2009 .

[10]  G. Miller The assessment of clinical skills/competence/performance , 1990, Academic medicine : journal of the Association of American Medical Colleges.

[11]  C. Salisbury,et al.  Patients’ experience and satisfaction in primary care: secondary analysis using multilevel modelling , 2010, BMJ : British Medical Journal.

[12]  梅屋 崇 海外視察報告 英国 Royal College of General Practitioners(RCGP) , 2012 .

[13]  A. Zaslavsky,et al.  Effects of survey mode, patient mix, and nonresponse on CAHPS hospital survey scores. , 2009, Health services research.

[14]  J. Rademakers,et al.  Structure, process or outcome: which contributes most to patients' overall assessment of healthcare quality? , 2011, Quality and Safety in Health Care.

[15]  J. Carline,et al.  Ratings of the performances of practicing internists by hospital‐based registered nurses , 1993, Academic medicine : journal of the Association of American Medical Colleges.

[16]  S. Kaplan,et al.  Correlates of satisfaction for the relationship with their physician in type 2 diabetic patients. , 2004, Diabetes research and clinical practice.

[17]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[18]  M. Roland,et al.  Changes in Patient Experiences of Primary Care During Health Service Reforms in England Between 2003 and 2007 , 2010, The Annals of Family Medicine.

[19]  C. Violato,et al.  Multisource feedback: a method of assessing surgical practice , 2003, BMJ : British Medical Journal.

[20]  J. B. Gregg,et al.  DEPARTMENT OF HEALTH. , 1910, California state journal of medicine.

[21]  C. Violato,et al.  Assessment of physician performance in Alberta: the physician achievement review. , 1999, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[22]  K. Mann,et al.  Responses of Rural Family Physicians and Their Colleague and Coworker Raters to a Multi-Source Feedback Process: A Pilot Study , 2003, Academic medicine : journal of the Association of American Medical Colleges.