Construct validity of instruments measuring impairments in body structures and function in rheumatic disorders: which constructs are selected for validation? A systematic review.

PURPOSE This paper focuses on the construct validity of instruments measuring impairments in body structures and function in rheumatic disorders. The objective is: 1) to make an inventory of constructs, based on the domains of the International Classification of Functioning, Disabilities and Health problems (ICF), against which instruments measuring impairments in body structures and function were validated; 2) to analyse whether validation against a similar construct resulted in higher correlation coefficients than validation against a dissimilar construct. METHODS In a systematic review papers were identified in which instruments measuring impairments in body structures and function for patients with rheumatic disorders were validated. The instruments identified were assessed on their methodological properties and the constructs against which they were validated. Subsequently, pooled (interclass) correlations of similar constructs and dissimilar constructs against which was validated were compared. An instrument was decided to have good construct validity, if the correlation coefficient was 0.50 or higher, and the measurement instrument in question is validated against similar constructs. RESULTS In total 216 papers were identified analysing the validity of 42 different instruments. Only 16% of these instruments were validated against instruments that represent the most similar construct. In general, estimates of construct validity were lower when validated against dissimilar constructs, except for instruments measuring impairments in mental functions. CONCLUSION There is a trend that validation against a similar construct yields higher correlation coefficients than validation against a dissimilar construct. If an instrument measuring impairments is validated against the most similar construct, and a criterion of r > 0.50 is applied, only 10 out of the 42 identified instruments turned out to be valid.

[1]  E. Ghiselli.  The measurement of occupational aptitude. , 1955, Publications in psychology.

[2]  D. Mccarty,et al.  A DOLORIMETER FOR QUANTIFICATION OF ARTICULAR TENDERNESS. , 1965, Arthritis and rheumatism.

[3]  W. Buchanan,et al.  Clinical studies with an articular index for the assessment of joint tenderness in patients with rheumatoid arthritis. , 1968, The Quarterly journal of medicine.

[4]  F. Hart,et al.  Spondylometry in a normal population and in ankylosing spondylitis. , 1973, Rheumatology and rehabilitation.

[5]  V. Wright,et al.  The pattern of chest and spinal mobility in ankylosing spondylitis. An objective clinical study of 106 patients. , 1973, Rheumatology and rehabilitation.

[6]  W. Dick,et al.  An assessment of grip strength measurement in rheumatoid arthritis. , 1974, Scandinavian journal of rheumatology.

[7]  P M Reynolds,et al.  Measurement of spinal mobility: a comparison of three methods. , 1975, Rheumatology and rehabilitation.

[8]  R. Melzack.  The McGill Pain Questionnaire: Major properties and scoring methods , 1975, PAIN.

[9]  W. Downie,et al.  Studies with pain rating scales. , 1978, Annals of the rheumatic diseases.

[10]  V. Rhind,et al.  A comparison of clinical assessments of disease activity in rheumatoid arthritis. , 1980, Annals of the rheumatic diseases.

[11]  P. Gertman,et al.  Measuring health status in arthritis. The arthritis impact measurement scales. , 1980, Arthritis and rheumatism.

[12]  C. Goldsmith,et al.  The modified sphygmomanometer-an instrument to measure muscle strength: a validation study. , 1981, Journal of chronic diseases.

[13]  R. Mallya,et al.  The assessment of disease activity in rheumatoid arthritis using a multivariate analysis. , 1981, Rheumatology and rehabilitation.

[14]  E. Huskisson,et al.  An articular index for the assessment of osteoarthritis. , 1981, Annals of the rheumatic diseases.

[15]  P. Gertman,et al.  The arthritis impact measurement scales. Further investigations of a health status measure. , 1982, Arthritis and rheumatism.

[16]  M. Guttadauria,et al.  Outcome assessment in clinical trials. Evidence for the sensitivity of a health status measure. , 1984, Arthritis and rheumatism.

[17]  G. Langley,et al.  Problems associated with pain measurement in arthritis: comparison of the visual analogue and verbal rating scales. , 1984, Clinical and experimental rheumatology.

[18]  R. Deyo,et al.  Toward clinical applications of health status measures: sensitivity of scales to clinically important changes. , 1984, Health services research.

[19]  M H Liang,et al.  Comparative measurement efficiency and sensitivity of five health status instruments for arthritis research. , 1985, Arthritis and rheumatism.

[20]  K. Wallston,et al.  The measurement of helplessness in rheumatoid arthritis. The development of the arthritis helplessness index. , 1985, The Journal of rheumatology.

[21]  P. Tugwell,et al.  Grading of tenderness as a source of interrater error in the Ritchie articular index. , 1985, The Journal of rheumatology.

[22]  C. Goldsmith,et al.  Patient, observer and instrument variation in the measurement of strength of shoulder abductor muscles in patients with rheumatoid arthritis using a modified sphygmomanometer. , 1986, The Journal of rheumatology.

[23]  J. Simpson,et al.  Studies with an enthesis index as a method of clinical assessment in ankylosing spondylitis. , 1987, Annals of the rheumatic diseases.

[24]  K. Brandt,et al.  Evidence of the validity of the Arthritis Impact Measurement Scales. , 1987, Arthritis and rheumatism.

[25]  R. Kane,et al.  What are we measuring? An examination of walk time and grip strength. , 1987, The Journal of rheumatology.

[26]  J. Nunley,et al.  Pain coping strategies in osteoarthritis patients. , 1987, Journal of consulting and clinical psychology.

[27]  K. Lorig,et al.  A nursing perspective on the assessment of function in persons with arthritis. , 1988, Research in nursing & health.

[28]  A. Kalla,et al.  Clinical assessment of disease activity in rheumatoid arthritis: evaluation of a functional test. , 1988, Annals of the rheumatic diseases.

[29]  M. Dougados,et al.  Evaluation of a functional index and an articular index in ankylosing spondylitis. , 1988, The Journal of rheumatology.

[30]  M. Liang,et al.  Effects of warming up on reliability of anthropometric techniques in ankylosing spondylitis. , 1988, Arthritis and rheumatism.

[31]  G. Norman,et al.  Tender points in fibromyalgia , 1988, Pain.

[32]  R. Meenan,et al.  SENSITIVITY OF A HEALTH STATUS MEASURE TO SHORT‐TERM CLINICAL CHANGES IN ARTHRITIS , 1989, Arthritis and rheumatism.

[33]  Lewis E. Kazis,et al.  Effect Sizes for Interpreting Changes in Health Status , 1989, Medical care.

[34]  K. Wallston,et al.  Comparing the short and long versions of the Arthritis Impact Measurement Scales. , 1989, The Journal of rheumatology.

[35]  E. Taal,et al.  Evaluation of the Dutch Arthritis Impact Measurement Scales (DUTCH-AIMS) in patients with rheumatoid arthritis. , 1989, British journal of rheumatology.

[36]  R. Fitzpatrick,et al.  A comparison of measures of health status in rheumatoid arthritis. , 1989, British journal of rheumatology.

[37]  D. Roth,et al.  Discriminant and convergent validity of self-report measures of affective distress in patients with rheumatoid arthritis. , 1989, The Journal of rheumatology.

[38]  T. Pincus,et al.  A simplified twenty-eight-joint quantitative articular index in rheumatoid arthritis. , 1989, Arthritis and rheumatism.

[39]  M. Liang,et al.  A modification of the Health Assessment Questionnaire for the spondyloarthropathies. , 1990, The Journal of rheumatology.

[40]  M. Ferraz,et al.  EPM-ROM Scale: an evaluative instrument to be used in rheumatoid arthritis trials. , 1990, Clinical and experimental rheumatology.

[41]  M. Liang,et al.  Comparisons of Five Health Status Instruments for Orthopedic Evaluation , 1990, Medical care.

[42]  M. Gustafsson,et al.  Rheumatoid arthritis: determination of pain characteristics and comparison of RAI and VAS in its measurement , 1990, Pain.

[43]  T. Pincus,et al.  Reliability of grip strength, walking time and button test performed according to a standard protocol. , 1991, The Journal of rheumatology.

[44]  T. Pincus,et al.  The Beck Depression Inventory, Center for Epidemiological Studies Depression Scale (CES-D), and General Well-Being Schedule depression subscale in rheumatoid arthritis. Criterion contamination of responses. , 1991, Arthritis care and research : the official journal of the Arthritis Health Professions Association.

[45]  D. Gladman,et al.  The utility of the arthritis impact measurement scales for patients with psoriatic arthritis. , 1992, The Journal of rheumatology.

[46]  C. P. van der Staak,et al.  [Pain in rheumatoid arthritis measured with the visual analogue scale and the Dutch version of the McGill Pain Questionnaire]. , 1992, Nederlands tijdschrift voor geneeskunde.

[47]  G. F. Hamilton,et al.  Measurement of grip strength: validity and reliability of the sphygmomanometer and jamar grip dynamometer. , 1992, The Journal of orthopaedic and sports physical therapy.

[48]  F. Wolfe,et al.  Sensitivity to change of the health assessment questionnaire (HAQ) and other clinical and health status measures in rheumatoid arthritis: results of short-term clinical trials and observational studies versus long-term observational studies. , 1992, Arthritis care and research : the official journal of the Arthritis Health Professions Association.

[49]  D. Buskila,et al.  Control and "fibrositic" tenderness: comparison of two dolorimeters. , 1992, The Journal of rheumatology.

[50]  M Schulzer,et al.  An electronic method for measuring joint tenderness in rheumatoid arthritis. , 1992, Arthritis and rheumatism.

[51]  G. Samsa,et al.  Generic versus disease specific health status measures: comparing the sickness impact profile and the arthritis impact measurement scales. , 1992, The Journal of rheumatology.

[52]  L. Kazis,et al.  AIMS2. The content and properties of a revised and expanded Arthritis Impact Measurement Scales Health Status Questionnaire. , 1992, Arthritis and rheumatism.

[53]  E. Taal,et al.  Opinions of patients with rheumatoid arthritis about their own functional capacity: how valid is it? , 1992, Annals of the rheumatic diseases.

[54]  M. Chernoff,et al.  Sensitivity to change of rheumatoid arthritis clinical trial outcome measures. , 1993, The Journal of rheumatology.

[55]  G. Grimby,et al.  Grip force in patients with rheumatoid arthritis and fibromyalgia and in healthy subjects. A study with the Grippit instrument. , 1993, Scandinavian journal of rheumatology.

[56]  Viitanen Jv.  Thoracolumbar rotation in ankylosing spondylitis. A new noninvasive measurement method. , 1993 .

[57]  L. Portney,et al.  Foundations of Clinical Research , 1993 .

[58]  J. Hazes,et al.  Evaluation of joint mobility in rheumatoid arthritis trials: the value of the EPM-range of motion scale. , 1993, The Journal of rheumatology.

[59]  J. Viitanen.  Thoracolumbar rotation in ankylosing spondylitis. A new noninvasive measurement method. , 1993, Spine.

[60]  S Ziebland,et al.  A comparison of the sensitivity to change of several health status instruments in rheumatoid arthritis. , 1993, The Journal of rheumatology.

[61]  S. van der Linden,et al.  Comparison between self-report measures and clinical observations of functional disability in ankylosing spondylitis, rheumatoid arthritis and fibromyalgia. , 1994, Journal of Rheumatology.

[62]  C. Burckhardt,et al.  A Swedish version of the short-form McGill Pain Questionnaire. , 1994, Scandinavian journal of rheumatology.

[63]  M. Eliasziw,et al.  Statistical methodology for the concurrent assessment of interrater and intrarater reliability: using goniometric measurements as an example. , 1994, Physical therapy.

[64]  A. Calin,et al.  A new approach to defining disease status in ankylosing spondylitis: the Bath Ankylosing Spondylitis Disease Activity Index. , 1994, The Journal of rheumatology.

[65]  A Calin,et al.  Defining spinal mobility in ankylosing spondylitis (AS). The Bath AS Metrology Index. , 1994, The Journal of rheumatology.

[66]  J. Wessel.  The reliability and validity of pain threshold measurements in osteoarthritis of the knee. , 1995, Scandinavian journal of rheumatology.

[67]  B. Dellhag,et al.  A Grip Ability Test for use in rheumatology practice. , 1995, The Journal of rheumatology.

[68]  P. Tugwell,et al.  Which outcome measures should be used in rheumatoid arthritis clinical trials? Clinical and quality-of-life measures' responsiveness to treatment in a randomized controlled trial. , 1995, Arthritis and rheumatism.

[69]  F. Breedveld,et al.  Validity and reliability of the twenty-eight-joint count for the assessment of rheumatoid arthritis activity. , 1995, Arthritis and rheumatism.

[70]  M. Schulzer,et al.  Reliability and Reproducibility of Fibromyalgic Tenderness, Measurement by Electronic and Mechanical Dolorimeters , 1995 .

[71]  J. Suni,et al.  The relative value of spinal and thoracic mobility measurements in ankylosing spondylitis. , 1995, Scandinavian journal of rheumatology.

[72]  L. Bouter,et al.  Measuring functional limitations in rising and sitting down: development of a questionnaire. , 1996, Archives of physical medicine and rehabilitation.

[73]  T. V. Vliet Vlieland,et al.  Determinants of hand function in patients with rheumatoid arthritis. , 1996, The Journal of rheumatology.

[74]  D. Gladman,et al.  Validation of the revised and expanded version of the Arthritis Impact Measurement Scales for patients with psoriatic Arthritis. , 1996, The Journal of rheumatology.

[75]  M. Prevoo,et al.  Validity and reproducibility of self-administered joint counts. A prospective longitudinal followup study in patients with rheumatoid arthritis. , 1996, The Journal of rheumatology.

[76]  O Wiegman,et al.  Evaluation of a Dutch version of the AIMS2 for patients with rheumatoid arthritis. , 1996, British journal of rheumatology.

[77]  Diane P. Martin,et al.  Comparison of the Musculoskeletal Function Assessment Questionnaire with the Short Form-36, the Western Ontario and McMaster Universities Osteoarthritis Index, and the Sickness Impact Profile Health-Status Measures* , 1997, The Journal of bone and joint surgery. American volume.

[78]  A. Finset,et al.  Measuring Change in Fibromyalgic Pain: The Relevance of Pain Distribution , 1997 .

[79]  G. Grimby,et al.  Assessments of disability in women with rheumatoid arthritis in relation to grip force and pain. , 1997, Disability and rehabilitation.

[80]  F. Breedveld,et al.  Measurement of morning stiffness in rheumatoid arthritis clinical trials. , 1997, Journal of clinical epidemiology.

[81]  Gordon Waddell,et al.  The Back Pain Revolution , 1998 .

[82]  M. Dougados,et al.  Defining disease activity in ankylosing spondylitis: is a combination of variables (Bath Ankylosing Spondylitis Disease Activity Index) an appropriate instrument? , 1999, Rheumatology.

[83]  F. Romero,et al.  Self-administered joint counts in rheumatoid arthritis: comparison with standard joint counts. , 1999, The Journal of rheumatology.

[84]  M. Dougados,et al.  A comparative study of the usefulness of the Bath Ankylosing Spondylitis Functional Index and the Dougados Functional Index in the assessment of ankylosing spondylitis. , 1999, The Journal of rheumatology.

[85]  H. Kautiainen,et al.  Sensitivity to change of mobility tests; effect of short term intensive physiotherapy and exercise on spinal, hip, and shoulder measurements in spondyloarthropathy. , 2000, The Journal of rheumatology.

[86]  M. Kokko,et al.  Clinical Assessment of Spinal Mobility Measurements in Ankylosing Spondylitis: A Compact Set for Follow-up and Trials? , 2000, Clinical Rheumatology.

[87]  P. Ingvarsson,et al.  Disturbed grip function in women with rheumatoid arthritis. , 2001, The Journal of rheumatology.

[88]  [Rheumatoid arthritis: determination of the current status]. , 2001, Zeitschrift fur Rheumatologie.

[89]  R. D. de Bie,et al.  ICF Core Sets for low back pain. , 2004, Journal of rehabilitation medicine.

[90]  A. Cieza,et al.  ICF Core Sets for osteoarthritis. , 2004, Journal of rehabilitation medicine.

[91]  G. Langley,et al.  A simple pressure dolorimeter for the quantification of joint tenderness in inflammatory arthritis , 2004, Rheumatology International.

[92]  D. Symmons,et al.  ICF Core Sets for rheumatoid arthritis. , 2004, Journal of rehabilitation medicine.

[93]  A. Cieza,et al.  ICF Core Sets for chronic widespread pain. , 2004, Journal of rehabilitation medicine.

[94]  A. Woolf,et al.  ICF Core Sets for osteoporosis. , 2004, Journal of rehabilitation medicine.

[95]  L. Bouter,et al.  Which are the best instruments for measuring disabilities in gait and gait-related activities in patients with rheumatic disorders. , 2004, Clinical and experimental rheumatology.

[96]  L. Bouter,et al.  Impairment measures in rheumatic disorders for rehabilitation medicine and allied health care: a systematic review , 2005, Rheumatology International.

[97]  L. Bouter,et al.  Reliability, validity and responsiveness of instruments to assess disabilities in personal care in patients with rheumatic disorders. A systematic review. , 2005, Clinical and experimental rheumatology.

[98]  Does a Muscle Strength Index Provide Complementary Information to Traditional Disease Activity Variables in Patients with Rheumatoid Arthritis ? , .