The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups.

The widespread use of standardized health surveys is predicated on the largely untested assumption that scales constructed from those surveys will satisfy minimum psychometric requirements across diverse population groups. Data from the Medical Outcomes Study (MOS) were used to evaluate data completeness and quality, test scaling assumptions, and estimate internal-consistency reliability for the eight scales constructed from the MOS SF-36 Health Survey. Analyses were conducted among 3,445 patients and were replicated across 24 subgroups differing in sociodemographic characteristics, diagnosis, and disease severity. For each scale, item-completion rates were high across all groups (88% to 95%), but tended to be somewhat lower among the elderly, those with less than a high school education, and those in poverty. On average, surveys were complete enough to compute scale scores for more than 96% of the sample. Across patient groups, all scales passed tests for item-internal consistency (97% passed) and item-discriminant validity (92% passed). Reliability coefficients ranged from a low of 0.65 to a high of 0.94 across scales (median=0.85) and varied somewhat across patient subgroups. Floor effects were negligible except for the two role disability scales. Noteworthy ceiling effects were observed for both role disability scales and the social functioning scale. These findings support the use of the SF-36 survey across the diverse populations studied and identify population groups in which use of standardized health status measures may or may not be problematic.

[1]  L. Cronbach Further Evidence on Response Sets and Test Design , 1950 .

[2]  L. Cronbach Essentials of psychological testing , 1960 .

[3]  G. Forehand,et al.  A Method for Correcting Item-Total Correlations for the Effect of Relevant Item Inclusion , 1962 .

[4]  G. Helmstadter,et al.  Principles of Psychological Measurement , 1964 .

[5]  G. William Walster,et al.  Effect of Reliability and Validity on Power of Statistical Tests , 1970 .

[6]  M. Bergner,et al.  The Sickness Impact Profile: Reliability of a Health Status Measure , 1976, Medical care.

[7]  J E Ware,et al.  Scales for measuring general health perceptions. , 1976, Health services research.

[8]  S. Katz,et al.  A Measure of Primary Sociobiological Functions , 1976, International journal of health services : planning, administration, evaluation.

[9]  William E. Pollard,et al.  Examination of variable errors of measurement in a survey-based social indicator , 1978 .

[10]  J. Nunnally Psychometric Theory (2nd ed), New York: McGraw-Hill. , 1978 .

[11]  J. Ware Effects of Acquiescent Response Set on Patient Satisfaction Ratings , 1978, Medical care.

[12]  J. Ware,et al.  Conceptualization and Measurement of Health for Adults in the Health Insurance Study: Vol. III, Mental Health , 1978 .

[13]  J. Ware,et al.  Conceptualization and Measurement of Health for Adults in the Health Insurance Study , 1979 .

[14]  J. Siemiatycki A comparison of mail, telephone, and home interview strategies for household health surveys. , 1979, American journal of public health.

[15]  P. Rockey,et al.  Behavioral dysfunction in hyperthyroidism. Improvement with treatment. , 1980, Archives of internal medicine.

[16]  J. P. Sutcliffe,et al.  On the relationship of reliability to statistical power. , 1980 .

[17]  S. Maxwell Dependent Variable Reliability and Determination of Sample Size , 1980 .

[18]  J. Mcewen,et al.  The development of a subjective health indicator. , 1980, Sociology of health & illness.

[19]  M. Bergner,et al.  The Sickness Impact Profile: Development and Final Revision of a Health Status Measure , 1981, Medical care.

[20]  E. Wagner,et al.  The Duke-UNC Health Profile: An Adult Health Status Instrument for Primary Care , 1981, Medical care.

[21]  David E. Kanouse,et al.  Controlling for Acquiescence Response Set in Scale Development , 1982 .

[22]  Life quality of patients with chronic obstructive pulmonary disease. , 1982, Archives of internal medicine.

[23]  R. Deyo,et al.  Physical and psychosocial function in rheumatoid arthritis. Clinical use of a self-administered health status instrument. , 1982, Archives of internal medicine.

[24]  E B Keeler,et al.  Does free care improve adults' health? Results from a randomized controlled trial. , 1983, The New England journal of medicine.

[25]  R. Deyo,et al.  Pitfalls in measuring the health status of Mexican Americans: comparative validity of the English and Spanish Sickness Impact Profile. , 1984, American journal of public health.

[26]  E. Lusk,et al.  Psychosocial status in chronic illness. A comparative analysis of six diagnostic groups. , 1984, The New England journal of medicine.

[27]  N. Lurie,et al.  Termination from Medi-Cal--does it affect health? , 1984, The New England journal of medicine.

[28]  F. M. Andrews Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach , 1984 .

[29]  L. Cobb,et al.  Health status of survivors of out-of-hospital cardiac arrest six months later. , 1984, American journal of public health.

[30]  M. Bergner,et al.  A cross-cultural comparison of health status values. , 1985, American journal of public health.

[31]  B Kirshner,et al.  A methodological framework for assessing health indices. , 1985, Journal of chronic diseases.

[32]  Timothy W. Smith,et al.  The sickness impact profile: a global measure of disability in chronic low back pain , 1985, Pain.

[33]  E G Lowrie,et al.  The quality of life of patients with end-stage renal disease. , 1985, The New England journal of medicine.

[34]  L. Cobb,et al.  Health status of survivors of cardiac arrest and of myocardial infarction controls. , 1985, American journal of public health.

[35]  C. Sherbourne,et al.  COMPARISON OF HEALTH OUTCOMES AT A HEALTH MAINTENANCE ORGANISATION WITH THOSE OF FEE-FOR-SERVICE CARE , 1986, The Lancet.

[36]  C. Bombardier,et al.  Auranofin therapy and quality of life in patients with rheumatoid arthritis. Results of a multicenter trial. , 1986, The American journal of medicine.

[37]  D. Battistutta,et al.  A comparison of costs and data quality of three health survey methods: mail, telephone and personal home interview. , 1986, American journal of epidemiology.

[38]  G. Klerman,et al.  The effects of antihypertensive therapy on the quality of life. , 1986, The New England journal of medicine.

[39]  D J Balaban,et al.  Weights for Scoring the Quality of Well-being Instrument Among Rheumatoid Arthritics: A Comparison to General Population Weights , 1986, Medical care.

[40]  Frank M. Andrews,et al.  The Quality of Survey Data as Related to Age of Respondent , 1986 .

[41]  B. O'brien,et al.  Measuring the effectiveness of heart transplant programmes: quality of life data and their relationship to survival analysis. , 1987, Journal of chronic diseases.

[42]  I. Wiklund,et al.  Cross-cultural variation in the weighting of health statements: A comparison of English and Swedish valuations , 1987 .

[43]  M. Bergner,et al.  Health status measures: an overview and guide for selection. , 1987, Annual review of public health.

[44]  L. Hart,et al.  The functional status of ESRD patients as measured by the Sickness Impact Profile. , 1987, Journal of chronic diseases.

[45]  A. Stewart,et al.  Assessment of function in routine clinical practice: description of the COOP Chart method and preliminary findings. , 1987, Journal of chronic diseases.

[46]  K. Wells,et al.  Development of a Brief Screening Instrument for Detecting Depressive Disorders , 1988, Medical care.

[47]  M. Yacoub,et al.  The Nottingham Health Profile as a measure of quality of life following combined heart and lung transplantation. , 1988, Journal of epidemiology and community health.

[48]  C. Bulpitt,et al.  QUALITY OF LIFE ON ANGINA THERAPY: A RANDOMISED CONTROLLED TRIAL OF TRANSDERMAL GLYCERYL TRINITRATE AGAINST PLACEBO , 1988, The Lancet.

[49]  M. Argyle,et al.  The Nottingham Health Profile: an analysis of its sensitivity in differentiating illness groups. , 1988, Social science & medicine.

[50]  A. Stewart,et al.  The MOS short-form general health survey. Reliability and validity in a patient population. , 1988, Medical care.

[51]  H. C. Hutchings,et al.  The cost effectiveness of auranofin: results of a randomized clinical trial. , 1988, The Journal of rheumatology.

[52]  A. Stewart,et al.  The functioning and well-being of depressed patients. Results from the Medical Outcomes Study. , 1989, JAMA.

[53]  S Greenfield,et al.  Detection of depressive disorder for patients receiving prepaid or fee-for-service care. Results from the Medical Outcomes Study. , 1989, JAMA.

[54]  A. Stewart,et al.  Functional status and well-being of patients with chronic conditions. Results from the Medical Outcomes Study. , 1989, JAMA.

[55]  C. Berry,et al.  Interday reliability of function assessment for a health status measure. The Quality of Well-Being scale. , 1989, Medical care.

[56]  R M Kaplan,et al.  The Quality of Well-Being Scale: Applications in AIDS, Cystic Fibrosis, and Arthritis , 1989, Medical care.

[57]  John E. Overall,et al.  Contradictions Can Never a Paradox Resolve , 1989 .

[58]  R B Wallace,et al.  Data quality and age: health and psychobehavioral correlates of item nonresponse and inconsistent responses. , 1989, Journal of gerontology.

[59]  S. Greenfield,et al.  The Medical Outcomes Study. An application of methods for monitoring the results of medical care. , 1989, JAMA.

[60]  K. Ritchie,et al.  The French version of the Nottingham Health Profile. A comparison of items weights with those of the source version. , 1990, Social science & medicine.

[61]  N. Lurie,et al.  Measuring Health Changes Among Severely III Patients: The Floor Phenomenon , 1990, Medical care.

[62]  Ron D. Hays,et al.  Beyond internal consistency reliability: Rationale and user’s guide for Multitrait Analysis Program on the microcomputer , 1990 .

[63]  M. Liang,et al.  Comparisons of Five Health Status Instruments for Orthopedic Evaluation , 1990, Medical care.

[64]  H. Rubin,et al.  A Health Status Questionnaire Using 30 Items From The Medical Outcomes Study: Preliminary Validation in Persons With Early HIV Infection , 1991, Medical care.

[65]  D. Nerenz,et al.  Ongoing assessment of health status in patients with diabetes mellitus. , 1992, Medical care.

[66]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[67]  Anastasia E. Raczek,et al.  The validity and relative precision of MOS short- and long-form health status scales and Dartmouth COOP charts. Results from the Medical Outcomes Study. , 1992, Medical care.

[68]  Comments on the Use of Health Status Assessment in Clinical Settings , 1992 .

[69]  K. Wells,et al.  The course of depression in adult outpatients. Results from the Medical Outcomes Study. , 1992, Archives of general psychiatry.

[70]  M. Liang,et al.  Comparative Measurement Sensitivity of Short and Longer Health Status Instruments , 1992, Medical care.

[71]  R. Kravitz,et al.  Differences in the mix of patients among medical specialties and systems of care. Results from the medical outcomes study. , 1992, JAMA.

[72]  J Alonso,et al.  Measurement of general health status of non-oxygen-dependent chronic obstructive pulmonary disease patients. , 1992, Medical care.

[73]  C. Sherbourne,et al.  Quality of self-report data: a comparison of older and younger chronically ill patients. , 1992, Journal of gerontology.

[74]  J. E. Brazier,et al.  Validating the SF-36 health survey questionnaire: new outcome measure for primary care. , 1992, BMJ.

[75]  P S Kurtin,et al.  Patient-based health status measures in outpatient dialysis. Early experiences in developing an outcomes assessment program. , 1992, Medical care.

[76]  D. Lansky,et al.  Using health status measures in the hospital setting: from acute care to 'outcomes management'. , 1992, Medical care.

[77]  J. Fleishman,et al.  Quality of Life in Persons with Human Immunodeficiency Virus Infection: Measurement by the Medical Outcomes Study Instrument , 1992, Annals of Internal Medicine.

[78]  A. Stewart,et al.  Measuring Functioning and Well-Being: The Medical Outcomes Study Approach , 1992 .

[79]  C. McHorney,et al.  The MOS 36‐Item Short‐Form Health Survey (SF‐36): II. Psychometric and Clinical Tests of Validity in Measuring Physical and Mental Health Constructs , 1993, Medical care.

[80]  L. Chambers The McMaster Health Index Questionnaire: an update , 1993 .

[81]  C. McHorney,et al.  Comparisons of the Costs and Quality of Norms for the SF-36 Health Survey Collected by Mail Versus Telephone Interview: Results From a National Survey , 1994, Medical care.