Reliability of patient-reported outcomes in rheumatoid arthritis patients: an observational prospective study.

OBJECTIVE Patient-reported outcomes (PROs) such as pain, patient global assessment (PGA) and fatigue are regularly assessed in RA patients. In the present study, we aimed to explore the reliability and smallest detectable differences (SDDs) of these PROs, and whether the time between assessments has an impact on reliability. METHODS Forty RA patients on stable treatment reported the three PROs daily over two subsequent months. We assessed the reliability of these measures by calculating intraclass correlation coefficients (ICCs) and the SDDs for 1-, 7-, 14- and 28-day test-retest intervals. RESULTS Overall, SDD and ICC were 25 mm and 0.67 for pain, 25 mm and 0.71 for PGA and 30 mm and 0.66 for fatigue, respectively. SDD was higher with longer time period between assessments, ranging from 19 mm (1-day intervals) to 30 mm (28-day intervals) for pain, 19 to 33 mm for PGA, and 26 to 34 mm for fatigue; correspondingly, ICC was smaller with longer intervals, and ranged between the 1- and the 28-day interval from 0.80 to 0.50 for pain, 0.83 to 0.57 for PGA and 0.76 to 0.58 for fatigue. The baseline simplified disease activity index did not have any influence on reliability. Lower baseline PRO scores led to smaller SDDs. CONCLUSION Reliability of pain, PGA and fatigue measurements is dependent on the tested time interval and the baseline levels. The relatively high SDDs, even for patients in the lowest tertiles of their PROs, indicate potential issues for assessment of the presence of remission.

[1]  T. Pincus,et al.  Test–retest reliability of disease activity core set measures and indices in rheumatoid arthritis , 2008, Annals of the rheumatic diseases.

[2]  P. Tugwell,et al.  It's Good to Feel Better But It's Better To Feel Good and Even Better to Feel Good as Soon as Possible for as Long as Possible. Response Criteria and the Importance of Change at OMERACT 10 , 2011, The Journal of Rheumatology.

[3]  P. Armitage,et al.  Statistical methods in medical research , 1971 .

[4]  J. Jacobs,et al.  Patient's global assessment of disease activity and patient's assessment of general health for rheumatoid arthritis activity assessment: are they equivalent? , 2012, Annals of the rheumatic diseases.

[5]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[6]  M. Liang,et al.  The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis. , 1988, Arthritis and rheumatism.

[7]  J. Kirwan,et al.  Outcomes generated by patients with rheumatoid arthritis: how important are they? , 2005, Musculoskeletal care.

[8]  J. Pope,et al.  The minimally important difference (MID) for patient-reported outcomes including pain, fatigue, sleep and the health assessment questionnaire disability index (HAQ-DI) in primary Sjögren's syndrome. , 2011, Clinical and experimental rheumatology.

[9]  E. Taal,et al.  Incorporating the patient perspective into outcome assessment in rheumatoid arthritis--progress at OMERACT 7. , 2005, The Journal of rheumatology.

[10]  Robert A. Lew,et al.  Design Based on Intra-Class Correlation Coefficients , 2010 .

[11]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[12]  M. Suarez‐Almazor,et al.  Progress on Incorporating the Patient Perspective in Outcome Assessment in Rheumatology and the Emergence of Life Impact Measures at OMERACT 9 , 2009, The Journal of Rheumatology.

[13]  D. Altman,et al.  Agreement Between Methods of Measurement with Multiple Observations Per Individual , 2007, Journal of biopharmaceutical statistics.

[14]  J. Greenberg,et al.  Patient Perspectives on Achieving Treat‐to‐Target Goals: A Critical Examination of Patient‐Reported Outcomes , 2013, Arthritis care & research.

[15]  M. Suarez‐Almazor,et al.  Patient perspective: fatigue as a recommended patient centered outcome measure in rheumatoid arthritis. , 2007, The Journal of rheumatology.

[16]  C. Bombardier,et al.  Minimum clinically important improvement and patient acceptable symptom state in pain and function in rheumatoid arthritis, ankylosing spondylitis, chronic back pain, hand osteoarthritis, and hip and knee osteoarthritis: Results from a prospective multinational study , 2012, Arthritis care & research.

[17]  H. Martínez,et al.  Learning from pain scales: patient perspective. , 2003, Journal of Rheumatology.

[18]  N. Bellamy,et al.  Science of assessment , 2005, Annals of the rheumatic diseases.

[19]  D. Solomon,et al.  Multimorbidity and rheumatic conditions—enhancing the concept of comorbidity , 2014, Nature Reviews Rheumatology.

[20]  P. Peloso,et al.  Definition of Nonresponse to Analgesic Treatment of Arthritic Pain: An Analytical Literature Review of the Smallest Detectable Difference, the Minimal Detectable Change, and the Minimal Clinically Important Difference on the Pain Visual Analog Scale , 2011, International journal of inflammation.

[21]  J. Smolen,et al.  Near misses of ACR/EULAR criteria for remission: effects of patient global assessment in Boolean and index-based definitions , 2012, Annals of the rheumatic diseases.

[22]  A. Silman,et al.  Rheumatoid arthritis classifi cation criteria : an American College of Rheumatology / European League Against Rheumatism collaborative initiative , 2010 .

[23]  J. Smolen,et al.  Definition of treatment response in rheumatoid arthritis based on the simplified and the clinical disease activity index , 2012, Annals of the rheumatic diseases.

[24]  D. Gladman,et al.  Methods for assessing responsiveness: a critical review and recommendations. , 2000, Journal of clinical epidemiology.

[25]  M. Dougados,et al.  Reporting of patient-reported outcomes in recent trials in rheumatoid arthritis: a systematic literature review , 2008, Annals of the rheumatic diseases.

[26]  D. Veale,et al.  Comparison of remission criteria in a tumour necrosis factor inhibitor treated rheumatoid arthritis longitudinal cohort: patient global health is a confounder , 2013, Arthritis Research & Therapy.

[27]  M. Weinblatt,et al.  Sustained rheumatoid arthritis remission is uncommon in clinical practice , 2012, Arthritis Research & Therapy.

[28]  J. Bortz,et al.  Forschungsmethoden und Evaluation , 1995 .

[29]  M. Boers,et al.  Reliability of measures of disease activity and disease damage in rheumatoid arthritis: implications for smallest detectable difference, minimal clinically important difference, and analysis of treatment effects in randomized controlled trials. , 2001, The Journal of rheumatology.

[30]  R. Geenen,et al.  Variability of fatigue during the day in patients with primary Sjögren's syndrome, systemic lupus erythematosus, and rheumatoid arthritis. , 2010, Clinical and experimental rheumatology.

[31]  Edward H. Haertel,et al.  4 Reliability Coefficients and Generalizability Theory , 2006 .

[32]  H. H. Kuper,et al.  The provisional ACR/EULAR definition of remission in RA: a comment on the patient global assessment criterion. , 2012, Rheumatology.

[33]  David T Felson,et al.  UvA-DARE (Digital Academic Repository) American College of Rheumatology/European League against Rheumatism provisional definition of remission in rheumatoid arthritis for clinical trials , 2011 .

[34]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[35]  J. Jacobs,et al.  Determinants of discordance in patients' and physicians' rating of rheumatoid arthritis disease activity , 2012, Arthritis care & research.

[36]  J. Smolen,et al.  Discrepancies between patients and physicians in their perceptions of rheumatoid arthritis disease activity. , 2012, Arthritis and rheumatism.

[37]  Maurizio Cutolo,et al.  Treating rheumatoid arthritis to target: recommendations of an international task force , 2010, Annals of the rheumatic diseases.

[38]  F. Wolfe,et al.  Validity and Reliability Problems with Patient Global as a Component of the ACR/EULAR Remission Criteria as Used in Clinical Practice , 2012, The Journal of Rheumatology.

[39]  J. Pope,et al.  Test-Retest Reliability of Patient Global Assessment and Physician Global Assessment in Rheumatoid Arthritis , 2009, The Journal of Rheumatology.

[40]  C. Terwee,et al.  The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. , 2010, Journal of clinical epidemiology.

[41]  S Senn,et al.  Analysis of serial measurements in medical research. , 1990, BMJ.