Can Methods Developed for Interpreting Group-level Patient-reported Outcome Data be Applied to Individual Patient Management?

Background: Patient-reported outcome (PRO) data may be used at 2 levels: to evaluate impacts of disease and treatment aggregated across individuals (group-level) and to screen/monitor individual patients to inform their management (individual-level). For PRO data to be useful at either level, we need to understand their clinical relevance. Purpose: To provide clarity on whether and how methods historically developed to interpret group-based PRO research results might be applied in clinical settings to enable PRO data from individual patients to inform their clinical management and decision-making. Methods: We first differentiate PRO-based decision-making required at group versus individual levels. We then summarize established group-based approaches to interpretation (anchor-based and distribution based), and more recent methods that draw on item calibrations and qualitative research methods. We then assess the applicability of these methods to individual patient data and individual-level decision-making. Findings: Group-based methods provide a range of thresholds that are useful in clinical care: some provide screening thresholds for patients who need additional clinical assessment and/or intervention, some provide thresholds for classifying an individual’s level of severity of symptoms or problems with function, and others provide thresholds for meaningful change when monitoring symptoms and functioning over time during or after interventions. Availability of established cut-points for screening and symptom severity, and normative/reference values, may play into choice of PRO measures for use in clinical care. Translatability of thresholds for meaningful change is more problematic because of the greater reliability needed at the individual-level versus group-level, but group-based methods may provide lower bound estimates. Caution is needed to set thresholds above bounds of measurement error to avoid “false-positive changes” triggering unwarranted alerts and action in clinic. Conclusions: While there are some challenges in applying available methods for interpreting group-based PRO results to individual patient data and clinical care—including myriad contextual factors that may influence an individual patient’s management and decision-making—they provide a useful starting point, and should be used pragmatically.

[1]  A. Wu,et al.  Interpreting and Acting on PRO Results in Clinical Practice: Lessons Learned From the PatientViewpoint System and Beyond , 2019, Medical care.

[2]  B. Reeve,et al.  PRO-Bookmarking to Estimate Clinical Thresholds for Patient-reported Symptoms and Function. , 2019, Medical care.

[3]  J. Bjorner,et al.  Applying PRO Reference Values to Communicate Clinically Relevant Information at the Point-of-care. , 2019, Medical care.

[4]  Stefan J Cano,et al.  A Rasch Measurement Theory Approach to Improve the Interpretation of Patient-reported Outcomes. , 2019, Medical care.

[5]  Qiuling Shi,et al.  Interpreting Patient-reported Outcome Scores for Clinical Research and Practice: Definition, Determination, and Application of Cutpoints , 2019, Medical care.

[6]  A. Girgis,et al.  Interpreting and Acting on the PRO Scores From the Patient-reported Outcomes for Personalized Treatment and Care (PROMPT-Care) eHealth System , 2019, Medical care.

[7]  Deborah M. Miller,et al.  Idio Scale Judgment: evaluation of a new method for estimating responder thresholds , 2017, Quality of Life Research.

[8]  R. Hays,et al.  The challenge of measuring intra-individual change in fatigue during cancer treatment , 2017, Quality of Life Research.

[9]  Claire F. Snyder,et al.  What do these scores mean? Presenting patient‐reported outcomes data to patients and clinicians to improve interpretability , 2017, Cancer.

[10]  Joanne Greenhalgh,et al.  Framework and guidance for implementing patient-reported outcomes in clinical practice: evidence, challenges and opportunities. , 2016, Journal of comparative effectiveness research.

[11]  E. Bantug,et al.  Engaging stakeholders to improve presentation of patient-reported outcomes data in clinical practice , 2016, Supportive Care in Cancer.

[12]  Claire F. Snyder,et al.  Communicating patient-reported outcome scores using graphic formats: results from a mixed-methods evaluation , 2015, Quality of Life Research.

[13]  N. Black,et al.  Functionality and feedback: a protocol for a realist synthesis of the collation, interpretation and utilisation of PROMs data to improve patient care , 2014, BMJ Open.

[14]  J. Browne,et al.  The experiences of professionals with using information from patient-reported outcome measures to improve the quality of healthcare: a systematic review of qualitative research , 2014, BMJ quality & safety.

[15]  P. Fayers,et al.  Evidence-based guidelines for interpreting change scores for the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. , 2012, European journal of cancer.

[16]  D. Osoba,et al.  Minimal important differences for interpreting health-related quality of life scores from the EORTC QLQ-C30 in lung cancer patients participating in randomized controlled trials , 2011, Supportive Care in Cancer.

[17]  M. King A point of minimal important difference (MID): a critique of terminology and methods , 2011, Expert review of pharmacoeconomics & outcomes research.

[18]  P. Fayers,et al.  What changes in health‐related quality of life matter to multiple myeloma patients? A prospective study * , 2010, European journal of haematology.

[19]  D. Osoba,et al.  Meta-analysis provides evidence-based effect sizes for a cancer-specific quality-of-life questionnaire, the FACT-G. , 2010, Journal of clinical epidemiology.

[20]  M. King,et al.  Improving patient outcomes through the routine use of patient‐reported data in cancer clinics: future directions , 2009, Psycho-oncology.

[21]  R. Hays,et al.  Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. , 2008, Journal of clinical epidemiology.

[22]  A. Bowling Health status assessment , 2007 .

[23]  C. Terwee,et al.  Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach , 2006, Quality of Life Research.

[24]  J. Steiner,et al.  Health and Quality of Life Outcomes , 2006 .

[25]  Ron D Hays,et al.  Evaluating the Statistical Significance of Health-Related Quality-Of-Life Change in Individual Patients , 2005, Evaluation & the health professions.

[26]  D. Eton,et al.  Combining Distribution- and Anchor-Based Approaches to Determine Minimally Important Differences , 2005, Evaluation & the health professions.

[27]  R. Hays,et al.  Approaches and Recommendations for Estimating Minimally Important Differences for Health-Related Quality of Life Measures , 2005, COPD.

[28]  D. Osoba,et al.  The clinical value and meaning of health-related quality-of-life outcomes in oncology , 2004 .

[29]  G. Norman,et al.  Interpretation of Changes in Health-related Quality of Life: The Remarkable Universality of Half a Standard Deviation , 2003, Medical care.

[30]  G. Guyatt,et al.  A critical look at transition ratings. , 2002, Journal of clinical epidemiology.

[31]  Gordon H Guyatt,et al.  Methods to explain the clinical significance of health status measures. , 2002, Mayo Clinic proceedings.

[32]  J. Farrar,et al.  Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale , 2001, PAIN.

[33]  RON D. HAYS,et al.  Item Response Theory and Health Outcomes Measurement in the 21st Century , 2000, Medical care.

[34]  J Alonso,et al.  Provision of feedback on perceived health status to health care professionals: a systematic review of its impact. , 2000, Medical care.

[35]  K. Meadows,et al.  The effectiveness of the use of patient-based measures of health in routine practice in improving the process and outcomes of patient care: a literature review. , 1999, Journal of evaluation in clinical practice.

[36]  W. Tierney,et al.  Further evidence supporting an SEM-based criterion for identifying meaningful intra-individual changes in health-related quality of life. , 1999, Journal of clinical epidemiology.

[37]  W M Tierney,et al.  Linking clinical relevance and statistical significance in evaluating intra-individual changes in health-related quality of life. , 1999, Medical care.

[38]  G. Regehr,et al.  Methodological problems in the retrospective computation of responsiveness to change: the lesson of Cronbach. , 1997, Journal of clinical epidemiology.

[39]  C. McHorney,et al.  Individual-patient monitoring in clinical practice: are available health status surveys adequate? , 1995, Quality of Life Research.

[40]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[41]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[42]  R. Deyo,et al.  Physical and psychosocial function in rheumatoid arthritis. Clinical use of a self-administered health status instrument. , 1982, Archives of internal medicine.

[43]  P. Fayers,et al.  Evidence-based guidelines for determination of sample size and interpretation of the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[44]  A. Wu,et al.  Health Status Assessment: Completing the Clinical Database , 2006, Journal of General Internal Medicine.

[45]  A. Culyer,et al.  False-negative results in screening programmes: systematic review of impact and implications. , 2000, Health technology assessment.

[46]  D. Osoba,et al.  Interpreting the significance of changes in health-related quality-of-life scores. , 1998, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.