Measuring patient views of physician communication skills: development and testing of the Communication Assessment Tool.

OBJECTIVE Interpersonal and communication skills have been identified as a core competency that must be demonstrated by physicians. We developed and tested a tool that can be used by patients to assess the interpersonal and communication skills of physicians-in-training and physicians-in-practice. METHODS We began by engaging in a systematic scale development process to obtain a psychometrically sound Communication Assessment Tool (CAT). This process yielded a 15-item instrument that is written at the fourth grade reading level and employs a five-point response scale, with 5=excellent. Fourteen items focus on the physician and one targets the staff. Pilot testing established that the CAT differentiates between physicians who rated high or low on a separate satisfaction scale. We conducted a field test with physicians and patients from a variety of specialties and regions within the US to assess the feasibility of using the CAT in everyday practice. RESULTS Thirty-eight physicians and 950 patients (25 patients per physician) participated in the field test. The average patient-reported mean score per physician was 4.68 across all CAT items (S.D.=0.54, range 3.97-4.95). The average proportion of excellent scores was 76.3% (S.D.=11.1, range 45.7-95.1%). Overall scale reliability was high (Cronbach's alpha=0.96); alpha coefficients were uniformly high when reliability was examined per doctor. CONCLUSION The CAT is a reliable and valid instrument for measuring patient perceptions of physician performance in the area of interpersonal and communication skills. The field test demonstrated that the CAT can be successfully completed by both physicians and patients across clinical specialties. Reporting the proportion of "excellent" ratings given by patients is more useful than summarizing scores via means, which are highly skewed. PRACTICE IMPLICATIONS Specialty boards, residency programs, medical schools, and practice plans may find the CAT valuable for both collecting information and providing feedback about interpersonal and communication skills.

[1]  utcomes-based Evaluation in Resident ducation : Creating Systems and tructured Portfolios , 2006 .

[2]  William C McGaghie,et al.  SPECIAL ARTICLE: Cognitive, Social and Environmental Sources of Bias in Clinical Performance Ratings , 2003, Teaching and learning in medicine.

[3]  G. Makoul.  The SEGUE Framework for teaching and assessing communication skills. , 2001, Patient education and counseling.

[4]  R. F. Potthoff.  Telephone sampling in epidemiologic research: to reap the benefits, avoid the pitfalls. , 1994, American journal of epidemiology.

[5]  T. Meehan,et al.  Primary care physicians, office-based practice, and the meaning of quality improvement. , 2005, The American journal of medicine.

[6]  G. Makoul,et al.  Health promotion in primary care: physician-patient communication and decision making about prescription medications. , 1995, Social science & medicine.

[7]  Jonathan Silverman,et al.  Skills for Communicating with Patients , 1998 .

[8]  R. Frankel,et al.  Getting the most out of the clinical encounter: the four habits model. , 1999, The Journal of medical practice management : MPM.

[9]  S. Kurtz,et al.  Teaching and Learning Communication Skills in Medicine , 2004 .

[10]  Joseph Waksberg,et al.  Sampling Methods for Random Digit Dialing , 1978 .

[11]  Edward Krupat,et al.  The Four Habits Coding Scheme: validation of an instrument to assess clinicians' communication behavior. , 2006, Patient education and counseling.

[12]  G. Makoul,et al.  Communication teaching and assessment in medical education: an international consensus statement. Netherlands Institute of Primary Health Care. , 1999, Patient education and counseling.

[13]  Paul Batalden,et al.  General competencies and accreditation in graduate medical education. , 2002, Health affairs.

[14]  S. Horowitz.  Evaluation of clinical competencies: basic certification, subspecialty certification, and recertification. , 2000, American journal of physical medicine & rehabilitation.

[15]  Jocelyn Lockyer,et al.  Assessment of a matched‐pair instrument to examine doctor−patient communication skills in practising doctors , 2007, Medical education.

[16]  Malcolm Puntis,et al.  Skills for Communicating with Patients (2nd edn) , 2006 .

[17]  J. Nunnally.  Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[18]  R. Frankel,et al.  Assessing Competence in Communication and Interpersonal Skills: The Kalamazoo II Report , 2004, Academic medicine : journal of the Association of American Medical Colleges.

[19]  P. Tate,et al.  Assessing physicians' interpersonal skills via videotaped encounters: a new approach for the Royal College of General Practitioners Membership examination. , 1999, Journal of health communication.

[20]  H. Wainer,et al.  Differential Item Functioning. , 1994 .

[21]  P. Tate,et al.  Patient centredness in the MRCGP video examination: analysis of large cohort , 2002, BMJ : British Medical Journal.

[22]  David A. Kindig,et al.  Health literacy : a prescription to end confusion , 2004 .

[23]  Understanding resistance to the data-model relationship in Rasch's paradigm: a reflection for the next generation. , 2002, Journal of applied measurement.

[24]  D. Scholtens,et al.  Communication about behavioral health risks: a study of videotaped encounters in 2 internal medicine practices. , 2006, Journal of general internal medicine.

[25]  G. Makoul,et al.  Essential Elements of Communication in Medical Encounters: The Kalamazoo Consensus Statement , 2001, Academic medicine : journal of the Association of American Medical Colleges.

[26]  T. Schofield.  Patient-Centered Medicine: Transforming the Clinical Method , 1995 .

[27]  David Andrich,et al.  Conditional pairwise estimation in the Rasch model for ordered response categories using principal components. , 2003, Journal of applied measurement.

[28]  J. Brown.  Patient-centred medicine: Transforming the clinical method , 1998 .