Considerations on the Use of Patient-Reported Outcomes in Comparative Effectiveness Research

Comparative effectiveness research (CER) involves studies that generate evidence through an evaluation of the spectrum of health care interventions and services that reflect patient choices for a given clinical situation, with the intent of improving patient and physician decision-making. In this paradigm, CER can be defined as a rigorous evaluation of the impact of different options that are available for treating a given medical condition for a particular set of patients.1 Such studies may compare similar treatments, such as competing drugs, or they may analyze very different approaches, like surgery and drug therapy.1 To date, the areas of emphasis in CER have primarily been on clinical endpoints, with extensive work in mixed and indirect treatment comparisons,2-3 use of Bayesian approaches,4 simulated treatment comparisons,5 realworld data use,6-8 and therapeutic index determination.9 Despite the potential role of patient-reported outcomes (PRO) data in CER, a central role for PRO data has not yet been fully established in CER because of the challenges associated with the collection and interpretation of such data within and across studies. A PRO is any report on the status of a patient’s health condition that comes directly from the patient.10 PRO is an umbrella term that includes a whole host of subjective outcomes, such as pain, fatigue, depression, aspects of well-being (e.g., physical, functional, psychological), treatment satisfaction, health-related quality of life, and physical symptoms, such as nausea and vomiting.11 In the traditional clinical research domain, there have been great advances with regard to the recognition of the role of PROs,12 as evidenced also by the recent publications of guidance documents by regulatory agencies.13-14 In different parts of the world, agencies or government bodies like the Institute for Quality and Efficiency in Healthcare (IQWiG) in Germany, the Pharmaceutical Benefits Advisory Committee (PBAC) in Australia, the National Institute of Health and Clinical Excellence (NICE) in the United Kingdom, and the Canadian Agency for Drugs and Technologies in Health (CADTH) in Canada have long histories of using PROs. While there are ongoing initiatives aimed at selecting preferred PRO instruments that would support validity and comparability of PRO measures and results, the use of PROs for CER is less defined than it is for regulatory approval. In this paper we discuss the role of PROs in CER, review the challenges associated with the inclusion of PROs in CER initiatives, provide a framework for their effective utilization, and propose several areas for future research.

[1]  R. Motzer,et al.  Quality of life in patients with metastatic renal cell carcinoma treated with sunitinib or interferon alfa: results from a phase III randomized trial. , 2008, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  David Cella,et al.  Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO Good Research Practices Task Force report. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[3]  J. Farrar,et al.  Use of the cumulative proportion of responders analysis graph to present pain data over a range of cut-off points: making clinical trial data more understandable. , 2006, Journal of pain and symptom management.

[4]  J. Ware SF-36 health survey: Manual and interpretation guide , 2003 .

[5]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[6]  J. Cappelleri,et al.  Interpretation of a Self-Esteem Subscale for Erectile Dysfunction by Cumulative Logit Model , 2007 .

[7]  J. Cappelleri,et al.  Self-esteem, confidence and relationship satisfaction of men with erectile dysfunction treated with sildenafil citrate: a multicenter, randomized, parallel group, double-blind, placebo controlled study in the United States. , 2006, Journal of Urology.

[8]  Patrick Marquis,et al.  A comprehensive strategy for the interpretation of quality-of-life data based on existing methods. , 2004, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[9]  Michael L. Johnson,et al.  Good research practices for comparative effectiveness research: analytic methods to improve causal inference from nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report--Part III. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[10]  P. Fayers,et al.  Quality of Life: The assessment, analysis and interpretation of patient-reported outcomes , 2007 .

[11]  M. A. Best Bayesian Approaches to Clinical Trials and Health‐Care Evaluation , 2005 .

[12]  D. Getsios,et al.  Sumatriptan: Economic Evidence for Its Use in the Treatment of Migraine, the Canadian Comparative Economic Analysis , 2001, Cephalalgia : an international journal of headache.

[13]  Susan D Horn,et al.  Practice Based Evidence: Incorporating Clinical Heterogeneity and Patient-Reported Outcomes for Comparative Effectiveness Research , 2010, Medical care.

[14]  D. Tulsky,et al.  The Functional Assessment of Cancer Therapy scale: development and validation of the general measure. , 1993, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[15]  R. Motzer,et al.  Quality of life predicts progression-free survival in patients with metastatic renal cell carcinoma treated with sunitinib versus interferon alfa. , 2009, Journal of oncology practice.

[16]  N. Leidy,et al.  Incorporating the patient's perspective into drug development and communication: an ad hoc task force report of the Patient-Reported Outcomes (PRO) Harmonization Group meeting at the Food and Drug Administration, February 16, 2001. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[17]  H. Schünemann,et al.  Applying quality-of-life data formally and systematically into clinical practice , 2003 .

[18]  Saul I. Gass,et al.  The Analytic Hierarchy Process - An Exposition , 2001, Oper. Res..

[19]  J. Cappelleri,et al.  Measurement properties of the Medical Outcomes Study Sleep Scale in patients with fibromyalgia. , 2009, Sleep medicine.

[20]  Gordon H Guyatt,et al.  Methods to explain the clinical significance of health status measures. , 2002, Mayo Clinic proceedings.

[21]  R. Westbury Use of the Dartmouth COOP Charts in a Calgary Practice , 1990 .

[22]  Keith Abrams,et al.  Use of Indirect and Mixed Treatment Comparisons for Technology Assessment , 2012, PharmacoEconomics.

[23]  S. Greenfield,et al.  Comparative Effectiveness Research: A Report From the Institute of Medicine , 2009, Annals of Internal Medicine.

[24]  J. Cappelleri,et al.  Analysis of single items on the Self‐Esteem And Relationship questionnaire in men treated with sildenafil citrate for erectile dysfunction: results of two double‐blind, placebo‐controlled trials , 2008, BJU international.

[25]  G. I. Ringdal,et al.  Testing the EORTC Quality of Life Questionnaire on cancer patients with heterogeneous diagnoses , 1993, Quality of Life Research.

[26]  L. Hedges,et al.  Introduction to Meta‐Analysis , 2009, International Coaching Psychology Review.

[27]  S P McKenna,et al.  The Nottingham Health Profile: subjective health status and medical consultations. , 1981, Social science & medicine. Part A, Medical sociology.

[28]  G. Lu,et al.  Combination of direct and indirect evidence in mixed treatment comparisons , 2004, Statistics in medicine.

[29]  Lewis E. Kazis,et al.  Effect Sizes for Interpreting Changes in Health Status , 1989, Medical care.

[30]  M. Bergner,et al.  The Sickness Impact Profile: Validation of a Health Status Measure , 1976, Medical care.

[31]  Joseph C. Cappelleri,et al.  The effects of pregabalin on sleep disturbance symptoms among individuals with fibromyalgia syndrome. , 2009, Sleep medicine.

[32]  R. Motzer,et al.  PCN72 HEALTH-RELATED QUALITY OF LIFE (HRQOL)AND KIDNEY CANCER-RELATED SYMPTOMS IN PATIENTS WITH METASTATIC RENAL CELL CARCINOMA (MRCC)TREATED WITH SUNITINIB VERSUS INTERFERON (IFN)-ALFA IN A RANDOMISED, MULTINATIONAL PHASE III TRIAL: RESULTS FOR EUROPEAN AND US SUBSAMPLE ANALYSES , 2007 .

[33]  Jeroen P Jansen,et al.  Bayesian meta-analysis of multiple treatment comparisons: an introduction to mixed treatment comparisons. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[34]  J. de Haes,et al.  Measuring psychological and physical distress in cancer patients: structure and application of the Rotterdam Symptom Checklist. , 1990, British Journal of Cancer.

[35]  David Atkins,et al.  Good research practices for comparative effectiveness research: defining, reporting and interpreting nonrandomized studies of treatment effects using secondary data sources: the ISPOR Good Research Practices for Retrospective Database Analysis Task Force Report--Part I. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[36]  J. Bridges,et al.  Identifying patient-relevant endpoints among individuals with schizophrenia: An application of patient-centered health technology assessment , 2009, International Journal of Technology Assessment in Health Care.

[37]  S. McKenna Measuring patient-reported outcomes: moving beyond misplaced common sense to hard science , 2011, BMC medicine.

[38]  M. Nübling,et al.  Preferences for treatment of Attention-Deficit/Hyperactivity Disorder (ADHD): a discrete choice experiment , 2009, BMC health services research.

[39]  Mark W. Lipsey,et al.  Practical Meta-Analysis , 2000 .

[40]  J. Fries,et al.  Improving patient reported outcomes using item response theory and computerized adaptive testing. , 2007, The Journal of rheumatology.

[41]  Ronette L. Kolotkin,et al.  PQP3: DEFINING CLINICALLY MEANINGFUL CHANGE IN HEALTH-RELATED QUALITY OF LIFE , 2001 .

[42]  J. Cappelleri,et al.  Development and evaluation of an abridged, 5-item version of the International Index of Erectile Function (IIEF-5) as a diagnostic tool for erectile dysfunction , 1999, International Journal of Impotence Research.

[43]  H. König,et al.  Validation of the EuroQol questionnaire in patients with inflammatory bowel disease , 2002, European journal of gastroenterology & hepatology.

[44]  Uwe Siebert,et al.  Good research practices for comparative effectiveness research: approaches to mitigate bias and confounding in the design of nonrandomized studies of treatment effects using secondary data sources: the International Society for Pharmacoeconomics and Outcomes Research Good Research Practices for Retr , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.