Internal medicine trainee self-assessments of end-of-life communication skills do not predict assessments of patients, families, or clinician-evaluators.

PURPOSE To investigate the strength of association between trainees' self-assessments of the quality of their end-of-life communication skills and the assessments of their patients, patients' families, and clinician-evaluators. METHODS As part of a randomized trial, pre-intervention survey data were collected at two sites from internal medicine trainees and their patients, patients' families, and clinician-evaluators. In this observational analysis, comparisons using regression analysis were made between (1) trainees' scores on a scale of perceived competence at communication about end-of-life care and (2) patients', families', and clinician-evaluators' scores on a questionnaire on the quality of end-of-life communication (QOC). Secondary analyses were performed using topic-focused subscales of these measures. RESULTS Internal medicine trainees (143) were studied with both self-assessment and external assessments. No significant associations were found between trainee perceived competence scores and primary outcome measures (p>0.05). Of the 12 secondary subscale analyses, trainees' self-ratings were significantly associated with external assessments for only one comparison, but the association was in the opposite direction with increased trainee ratings being significantly associated with decreased family ratings on "treatment discussions." We also examined the correlation between ratings by patients, family, and clinician-evaluators, which showed significant correlations (p<0.05) for 7 of 18 comparisons (38.9%). CONCLUSIONS Trainee self-evaluations do not predict assessments by their patients, patients' families, or their clinician-evaluators regarding the quality of end-of-life communication. Although these results should be confirmed using the same measures across all raters, in the meantime efforts to improve communication about end-of-life care should consider outcomes other than physician self-assessment to determine intervention success.

[1]  D. Au,et al.  A randomized trial to improve communication about end-of-life care among patients with COPD. , 2012, Chest.

[2]  Michael C Reade,et al.  The impact of advance care planning on end of life care in elderly patients: randomised controlled trial , 2010, BMJ : British Medical Journal.

[3]  J. Curtis,et al.  Medicine Residents' Self-Perceived Competence in End-of-Life Care , 2009, Academic medicine : journal of the Association of American Medical Colleges.

[4]  P. Maciejewski,et al.  Associations between end-of-life discussions, patient mental health, medical care near death, and caregiver bereavement adjustment. , 2008, JAMA.

[5]  S. Suglia,et al.  Evaluating an End-of-Life Curriculum in a Medical Residency Program , 2007, The American journal of hospice & palliative care.

[6]  Sylvia Bereknyei,et al.  Toward shared decision making at the end of life in intensive care units: opportunities for improvement. , 2007, Archives of internal medicine.

[7]  J. Curtis,et al.  Psychometric characteristics of a quality of communication questionnaire assessing communication about end-of-life care. , 2006, Journal of palliative medicine.

[8]  Michael Fordis,et al.  Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. , 2006, JAMA.

[9]  G. Alexander,et al.  Assessing competence of residents to discuss end-of-life issues. , 2005, Journal of palliative medicine.

[10]  Justin M Amery,et al.  A study into the educational needs of children's hospice doctors: a descriptive quantitative and qualitative survey , 2004, Palliative medicine.

[11]  B. Varkey,et al.  Palliative care education integrated into a geriatrics rotation for resident physicians. , 2004, Journal of palliative medicine.

[12]  D. Patrick,et al.  Patient-physician communication about end-of-life care for patients with severe COPD , 2004, European Respiratory Journal.

[13]  J. O’Leary,et al.  Prognosis Communication in Serious Illness: Perceptions of Older Patients, Caregivers, and Clinicians , 2003, Journal of the American Geriatrics Society.

[14]  Kevin W Eva,et al.  The Aging Physician: Changes in Cognitive Processing and Their Impact on Medical Practice , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[15]  J. Carline,et al.  Patients' perspectives on physician skill in end-of-life care: differences between patients with COPD, cancer, and AIDS. , 2002, Chest.

[16]  S. Block,et al.  ACGME Requirements for End‐of‐life Training in Selected Residency and Fellowship Programs: A Status Report , 2002, Academic medicine : journal of the Association of American Medical Colleges.

[17]  A. Abernethy,et al.  Families looking back: One year after discussion of withdrawal or withholding of life-sustaining support , 2001, Critical care medicine.

[18]  N. Christakis,et al.  Factors considered important at the end of life by patients, family, physicians, and other care providers. , 2000, JAMA.

[19]  Nicholas Christakis,et al.  In Search of a Good Death: Observations of Patients, Families, and Providers , 2000, Annals of Internal Medicine.

[20]  N. Christakis,et al.  Extent and determinants of error in doctors' prognoses in terminally ill patients: prospective cohort study , 2000, BMJ : British Medical Journal.

[21]  D. Patrick,et al.  The quality of patient-doctor communication about end-of-life care: a study of patients with advanced AIDS and their primary care clinicians. , 1999, AIDS.

[22]  P. Singer,et al.  Quality end-of-life care: patients' perspectives. , 1999, JAMA.

[23]  D. Johnson,et al.  Comparison of self, nurse, and physician assessment of residents rotating through an intensive care unit. , 1998, Critical care medicine.

[24]  M. Hume.  Improving care at the end of life. , 1998, The Quality Letter for Healthcare Leaders.

[25]  Gary Fischer,et al.  Opening the Black Box: How Do Physicians Communicate about Advance Directives? , 1998, Annals of Internal Medicine.

[26]  J. Tulsky,et al.  Patient knowledge and physician predictions of treatment preferences after discussion of advance directives , 1998, Journal of General Internal Medicine.

[27]  L. Stepp.  Approaching Death: Improving Care at the End of Life , 1998, Annals of Internal Medicine.

[28]  J. Garrett,et al.  What Is Wrong With End‐of‐Life Care? Opinions of Bereaved Family Members , 1997, Journal of the American Geriatrics Society.

[29]  J. Tulsky,et al.  See One, Do One, Teach One?: House Staff Experience Discussing Do-Not-Resuscitate Orders , 1996 .

[30]  R. Henry,et al.  Residents’ attitudes towards and skills in counseling , 1990, Journal of General Internal Medicine.

[31]  J. Carline,et al.  Understanding physicians' skills at providing end-of-life care perspectives of patients, families, and health care workers. , 2001 .

[32]  N. Wenger,et al.  Measuring quality in end-of-life care. , 2000, Clinics in geriatric medicine.

[33]  D. Dillman.  The Design and Administration of Mail Surveys , 1991 .

[34]  C. Mackenzie,et al.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. , 1987, Journal of chronic diseases.