Clinimetric evaluation of shoulder disability questionnaires: a systematic review of the literature

OBJECTIVE To identify all available shoulder disability questionnaires designed to measure physical functioning and to evaluate evidence for the clinimetric quality of these instruments. METHODS Systematic literature searches were performed to identify self administered shoulder disability questionnaires. A checklist was developed to evaluate and compare the clinimetric quality of the instruments. RESULTS Two reviewers identified and evaluated 16 questionnaires by our checklist. Most studies were found for the Disability of the Arm, Shoulder, and Hand scale (DASH), the Shoulder Pain and Disability Index (SPADI), and the American Shoulder and Elbow Surgeons Standardised Shoulder Assessment Form (ASES). None of the questionnaires demonstrated satisfactory results for all properties. Most questionnaires claim to measure several domains (for example, pain, physical, emotional, and social functioning), yet dimensionality was studied in only three instruments. The internal consistency was calculated for seven questionnaires and only one received an adequate rating. Twelve questionnaires received positive ratings for construct validity, although depending on the population studied, four of these questionnaires received poor ratings too. Seven questionnaires were shown to have adequate test-retest reliability (ICC >0.70), but five questionnaires were tested inadequately. In most clinimetric studies only small sample sizes (n<43) were used. Nearly all publications lacked information on the interpretation of scores. CONCLUSION The DASH, SPADI, and ASES have been studied most extensively, and yet even published validation studies of these instruments have limitations in study design, sample sizes, or evidence for dimensionality. Overall, the DASH received the best ratings for its clinimetric properties.

[1]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[2]  C. Rowe,et al.  The Bankart procedure: a long-term end-result study. , 1978, The Journal of bone and joint surgery. American volume.

[3]  R. Sitgreaves Psychometric theory (2nd ed.). , 1979 .

[4]  H. Holman,et al.  Measurement of patient outcome in arthritis. , 1980, Arthritis and rheumatism.

[5]  Amstutz Hc,et al.  UCLA anatomic total shoulder arthroplasty. , 1981 .

[6]  M. Bergner,et al.  The Sickness Impact Profile: Development and Final Revision of a Health Status Measure , 1981, Medical care.

[7]  I. Clarke,et al.  UCLA anatomic total shoulder arthroplasty. , 1981, Clinical orthopaedics and related research.

[8]  B Kirshner,et al.  A methodological framework for assessing health indices. , 1985, Journal of chronic diseases.

[9]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[10]  G. Hanker,et al.  Repair of the rotator cuff. End-result study of factors influencing reconstruction. , 1986, The Journal of bone and joint surgery. American volume.

[11]  C. Constant,et al.  A clinical method of functional assessment of the shoulder. , 1987, Clinical orthopaedics and related research.

[12]  P Tugwell,et al.  Methodological considerations in functional assessment. , 1987, The Journal of rheumatology. Supplement.

[13]  G. Guyatt,et al.  Measuring change over time: assessing the usefulness of evaluative instruments. , 1987, Journal of chronic diseases.

[14]  K. Roach,et al.  Development of a shoulder pain and disability index. , 1991, Arthritis care and research : the official journal of the Arthritis Health Professions Association.

[15]  R A Deyo,et al.  Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation. , 1991, Controlled clinical trials.

[16]  C. Sherbourne,et al.  The MOS 36-Item Short-Form Health Survey (SF-36) , 1992 .

[17]  Ware J.E.Jr.,et al.  THE MOS 36- ITEM SHORT FORM HEALTH SURVEY (SF- 36) CONCEPTUAL FRAMEWORK AND ITEM SELECTION , 1992 .

[18]  L. Kazis,et al.  AIMS2. The content and properties of a revised and expanded Arthritis Impact Measurement Scales Health Status Questionnaire. , 1992, Arthritis and rheumatism.

[19]  Freddie H. Fu,et al.  The Shoulder: A Balance of Mobility and Stability , 1993 .

[20]  Keith F Widaman,et al.  Confirmatory factor analysis and item response theory: two approaches for exploring measurement invariance. , 1993, Psychological bulletin.

[21]  D. T. Harryman,et al.  A practical tool for evaluating function: The simple shoulder test , 1993 .

[22]  A. Silman,et al.  Measurement of shoulder related disability: results of a validation study. , 1994, Annals of the rheumatic diseases.

[23]  C. Sherbourne,et al.  The MOS 36-item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. , 1994 .

[24]  V C Mow,et al.  A standardized method for the assessment of shoulder function. , 1994, Journal of shoulder and elbow surgery.

[25]  D. Simel,et al.  Measuring shoulder function with the Shoulder Pain and Disability Index. , 1995, The Journal of rheumatology.

[26]  K. Roach,et al.  Development of the Wheelchair User's Shoulder Pain Index (WUSPI) , 1995, Paraplegia.

[27]  A. Carr,et al.  Questionnaire on the perceptions of patients about shoulder surgery. , 1996, The Journal of bone and joint surgery. British volume.

[28]  J. Arendzen,et al.  A shoulder pain score: a comprehensive questionnaire for assessing pain in patients with shoulder complaints. , 1996, Scandinavian journal of rehabilitation medicine.

[29]  D. Simonson,et al.  Assessment of quality-of-life outcomes. , 1996, The New England journal of medicine.

[30]  C. Bombardier,et al.  Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG) , 1996, American journal of industrial medicine.

[31]  B. Bach,et al.  Scoring Systems for Shoulder Conditions , 1996, The American journal of sports medicine.

[32]  C. Bombardier,et al.  Development of an upper extremity outcome measure: The DASH (disabilities of the arm, shoulder, and head) , 1996 .

[33]  D. Beaton,et al.  Measuring Function of the Shoulder. A Cross-Sectional Comparison of Five Questionnaires* , 1996, The Journal of bone and joint surgery. American volume.

[34]  K N Lohr,et al.  Evaluating quality-of-life and health status instruments: development of scientific review criteria. , 1996, Clinical therapeutics.

[35]  M Feuerstein,et al.  Measuring functional outcomes in work-related upper extremity disorders. Development and validation of the Upper Extremity Function Scale. , 1997, Journal of occupational and environmental medicine.

[36]  R. Dodenhoff,et al.  Proximal Thigh Pain after Femoral Nailing: Causes and Treatment , 1997 .

[37]  Steven B Cohen,et al.  A Self-Administered Questionnaire for Assessment of Symptoms and Function of the Shoulder* , 1997, The Journal of bone and joint surgery. American volume.

[38]  J. Moseley,et al.  Shoulder symptoms in healthy athletes: a comparison of outcome scoring systems. , 1997, Journal of shoulder and elbow surgery.

[39]  S. Heald,et al.  The shoulder pain and disability index: the construct validity and responsiveness of a region-specific disability measure. , 1997, Physical therapy.

[40]  L. D. de Witte,et al.  Assessing the responsiveness of a functional status measure: the Sickness Impact Profile versus the SIP68. , 1997, Journal of clinical epidemiology.

[41]  R. Richards,et al.  Assessing the reliability and responsiveness of 5 shoulder questionnaires. , 1998, Journal of shoulder and elbow surgery.

[42]  P. Croft,et al.  Measuring up to shoulder pain , 1998, Annals of the rheumatic diseases.

[43]  A. Carr,et al.  A self-administered questionnaire for assessment of symptoms and function of the shoulder. , 1998, The Journal of bone and joint surgery. American volume.

[44]  L. Bouter,et al.  The responsiveness of the Shoulder Disability Questionnaire , 1998, Annals of the rheumatic diseases.

[45]  J A Shea,et al.  The Capabilities of Upper Extremity instrument: reliability and validity of a measure of functional limitation in tetraplegia. , 1998, Archives of physical medicine and rehabilitation.

[46]  M J Buxton,et al.  Evaluating patient-based outcome measures for use in clinical trials. , 1998, Health technology assessment.

[47]  A. Carr,et al.  THE DEVELOPMENT AND VALIDATION OF A QUESTIONNAIRE , 1999 .

[48]  A. Carr,et al.  The assessment of shoulder instability. The development and validation of a questionnaire. , 1999, The Journal of bone and joint surgery. British volume.

[49]  R. Doughty,et al.  Measuring health-related quality of life. , 1999, The New Zealand medical journal.

[50]  K. Meadows,et al.  The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: a literature review. , 1999, Journal of evaluation in clinical practice.

[51]  G H Guyatt,et al.  Making sense of quality-of-life data. , 2000, Medical care.

[52]  L M Bouter,et al.  Shoulder disability questionnaire design and responsiveness of a functional status measure. , 2000, Journal of clinical epidemiology.

[53]  U. Bosch,et al.  Outcome analysis following open rotator cuff repair. Early effectiveness validated using four different shoulder assessment scales , 2000, Archives of Orthopaedic and Trauma Surgery.

[54]  C. McHorney,et al.  Equating Health Status Measures With Item Response Theory: Illustrations With Functional Status Items , 2000, Medical care.

[55]  RON D. HAYS,et al.  Item Response Theory and Health Outcomes Measurement in the 21st Century , 2000, Medical care.

[56]  F. Savoie,et al.  Repair of the rotator cuff. Mini-open and arthroscopic repairs. , 2000, Clinics in sports medicine.

[57]  N. Mohtadi,et al.  Two 6-year follow-up studies of large and massive rotator cuff tears: comparison of outcome measures. , 2000, Journal of shoulder and elbow surgery.

[58]  K. Cook,et al.  Comparison of the University of California-Los Angeles Shoulder Scale and the Simple Shoulder Test with the shoulder pain and disability index: single-administration reliability and validity. , 2000, Physical therapy.

[59]  C. Bombardier,et al.  Measuring the whole or the parts? Validity, reliability, and responsiveness of the Disabilities of the Arm, Shoulder and Hand outcome measure in different regions of the upper extremity. , 2001, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[60]  Suzanne G. Leveille,et al.  Severity of upper and lower extremity functional limitation: scale development and validation with self-report and performance-based measures of physical function. WHAS Research Group. Women's Health and Aging Study. , 2001, The journals of gerontology. Series B, Psychological sciences and social sciences.

[61]  T. Armstrong,et al.  Test-retest reliability of the Upper Extremity Questionnaire among keyboard operators. , 2001, American journal of industrial medicine.

[62]  K. Cook,et al.  The measurement level and trait-specific reliability of 4 scales of shoulder functioning: an empiric investigation. , 2001, Archives of physical medicine and rehabilitation.

[63]  A. Kirkley,et al.  The development of a disease-specific quality of life measurement tool for osteoarthritis of the shoulder: The Western Ontario Osteoarthritis of the Shoulder (WOOS) index. , 2001, Osteoarthritis and cartilage.

[64]  I J Higginson,et al.  Using quality of life measures in the clinical setting , 2001, BMJ : British Medical Journal.

[65]  J. Seiler,et al.  Evaluation of the construct validity of the DASH questionnaire by correlation to the SF-36. , 2002, The Journal of hand surgery.

[66]  L. Samaranayake,et al.  Staphylococci may indeed cause acute dental infections , 2002, BMJ : British Medical Journal.

[67]  K. Cook,et al.  Reliability by surgical status of self-reported outcomes in patients who have shoulder pathologies. , 2002, The Journal of orthopaedic and sports physical therapy.

[68]  M. Hyland Recommendations from quality of life scales are not simple , 2002, BMJ : British Medical Journal.

[69]  Ray Fitzpatrick,et al.  Quality of life measurement: bibliographic study of patient assessed health outcome measures , 2002, BMJ : British Medical Journal.

[70]  A. Kirkley,et al.  Scoring systems for the functional assessment of the shoulder. , 2003, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[71]  D. Kohn,et al.  The subjective shoulder rating system , 2004, Archives of Orthopaedic and Trauma Surgery.

[72]  C. Terwee,et al.  On assessing responsiveness of health-related quality of life instruments: Guidelines for instrument evaluation , 2003, Quality of Life Research.

[73]  C. Bombardier,et al.  Development of a measure of physical function for patients with bone and soft tissue sarcoma , 1996, Quality of Life Research.

[74]  R. Hays,et al.  Psychometric considerations in evaluating health-related quality of life measures , 1993, Quality of Life Research.

[75]  R. Epstein,et al.  Interpretation of quality of life changes , 1993, Quality of Life Research.

[76]  C. McHorney,et al.  Individual-patient monitoring in clinical practice: are available health status surveys adequate? , 1995, Quality of Life Research.

[77]  L. Rajmil Health measurement scales. A practical guide to their development and use, 3rd ed , 2005 .