Problems in Using Health Survey Questionnaires in Older Patients with Physical Disabilities

Background: The SF-36 Health Survey questionnaire has been proposed as a generic measure of health outcome. However, poor rates of return and high levels of missing data have been found in elderly subjects and, even with face-to-face interview, reliability and validity may still be disappointing, particularly in cognitively impaired patients. These patients may be the very patients whose quality of life is most affected by their illness and their exclusion will lead to biased evaluation of health status. A possible alternative to total exclusion is the use of a proxy to answer on the patient’s behalf, but few studies of older people have systematically studied patient-proxy agreement. Objective: To compare the agreement between patients, lay and professional proxies when assessing the health status of patients with the SF-36. Methods: The SF-36 was administered by interview to 164 cognitively normal, elderly patients (Mini-mental State Examination 24 or more) referred for physical rehabilitation. The SF-36 was also completed by a patient-designated lay proxy (by post) and a professional proxy. Agreement between proxies and patients was measured by intraclass correlation coefficients (ICCs), and a bias index. Results: Professional proxies were better able to predict the patients’ responses than were the lay proxies. Criterion levels of agreement (ICC 0.4 or over) were attained for four of the eight dimensions of the SF-36 by professional proxies, but for only one dimension by lay proxies. In professional proxies, the magnitude of the bias was absent or slight (<0.2) for six of the eight dimensions of the SF-36 with a small (0.2–0.49) negative bias for the other two. Lay proxies showed a negative bias (i.e. they reported poorer function than did the patients themselves) for seven of the eight dimensions of the SF-36 (small in two and moderate (0.5–0.79) in five). Conclusions: For group comparisons using the SF-36, professional proxies might be considered when patients cannot answer reliably for themselves. However, in the present study, lay proxy performance on a postal questionnaire showed a strong tendency to negative bias. Further research is required to define the limitations and potentials of proxy completion of health status questionnaires.

[1]  J. Crawford,et al.  Problems in using health survey questionnaires in older patients with physical disabilities. The reliability and validity of the SF-36 and the effect of cognitive impairment. , 2001, Journal of evaluation in clinical practice.

[2]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[3]  S. Peet,et al.  Measuring health status in older patients. The SF-36 in practice. , 1998, Age and ageing.

[4]  S. Bassett,et al.  Use of proxies to measure health and functional status in epidemiologic studies of community-dwelling women aged 65 years and older. , 1996, American journal of epidemiology.

[5]  D. Feeny,et al.  Does it matter whom and how you ask? inter- and intra-rater agreement in the Ontario Health Survey. , 1997, Journal of clinical epidemiology.

[6]  T. Tombaugh,et al.  The Mini‐Mental State Examination: A Comprehensive Review , 1992, Journal of the American Geriatrics Society.

[7]  S. Ridley,et al.  Reliability of the next of kins' estimates of critically ill patients' quality of life , 1997, Anaesthesia.

[8]  M. Abdalla,et al.  The SF36 health survey questionnaire: an outcome measure suitable for routine use within the NHS? , 1993, BMJ.

[9]  S. Mallinson,et al.  The Short-Form 36 and older people: some problems encountered when using postal administration. , 1998, Journal of epidemiology and community health.

[10]  P Sandercock,et al.  Are proxy assessments of health status after stroke with the EuroQol questionnaire feasible, accurate, and unbiased? , 1997, Stroke.

[11]  M. Limburg,et al.  Assessing quality of life after stroke. The value and limitations of proxy ratings. , 1997, Stroke.

[12]  C. Sherbourne,et al.  The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. , 1994 .

[13]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[14]  S. Bassett,et al.  Reliability of proxy response on mental health indices for aged, community-dwelling women. , 1990, Psychology and aging.

[15]  J. Morris,et al.  The SF-36 health survey questionnaire: is it suitable for use with older adults? , 1995, Age and ageing.

[16]  E. Andresen,et al.  Test-retest performance of a mailed version of the Medical Outcomes Study 36-Item Short-Form Health Survey among older adults. , 1996, Medical care.

[17]  R A Lyons,et al.  SF-36 scores vary by method of administration: implications for study design. , 1999, Journal of public health medicine.

[18]  R. Wallace,et al.  The Epidemiologic study of the elderly , 1992 .

[19]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[20]  S. Zimmerman,et al.  Proxy reporting in five areas of functional status. Comparison with self-reports and observations of performance. , 1997, American journal of epidemiology.

[21]  D. Hickam,et al.  The Validity of Proxy-Generated Scores as Measures of Patient Health Status , 1991, Medical care.

[22]  J. Ware SF-36 health survey: Manual and interpretation guide , 2003 .

[23]  H Rodgers,et al.  Is the SF-36 suitable for assessing health status of older stroke patients? , 1998, Age and ageing.

[24]  W J MacLennan,et al.  The accuracy of self and informant ratings of physical functional capacity in the elderly. , 1992, Journal of clinical epidemiology.

[25]  J. Hanley,et al.  Proxy use of the Canadian SF-36 in rating health status of the disabled elderly. , 1998, Journal of clinical epidemiology.

[26]  D. Berlowitz,et al.  Health‐Related Quality of Life of Nursing Home Residents: Differences in Patient and Provider Perceptions , 1995, Journal of the American Geriatrics Society.

[27]  I McDowell,et al.  Reported activities of daily living: agreement between elderly subjects with and without dementia and their caregivers. , 1997, Age and ageing.

[28]  T. Perneger What's wrong with Bonferroni adjustments , 1998, BMJ.