Design and Analysis Issues for Economic Analysis Alongside Clinical Trials

Introduction:Clinical trials can offer a valuable and efficient opportunity to collect the health resource use and outcomes data for economic evaluation. However, economic and clinical studies differ fundamentally in the question they seek to answer. Objective:The design and analysis of trial-based cost-effectiveness studies require special consideration, which are reviewed in this article. Summary:Traditional randomized controlled trials, using an experimental design with a controlled protocol, are designed to measure safety and efficacy for product registration. Cost-effectiveness analysis seeks to measure effectiveness in the context of routine clinical practice, and requires collection of health care resources to allow estimation of cost over an equal timeframe for each treatment alternative. In assessing suitability of a trial for economic data collection, the comparator treatment and other protocol factors need to reflect current clinical practice and the trial follow-up must be sufficiently long to capture important costs and effects. The broadest available population and a measure of effectiveness reflecting important benefits for patients are preferred for economic analyses. Special analytical issues include dealing with missing and censored cost data, assessing uncertainty of the incremental cost-effectiveness ratio, and accounting for the underlying heterogeneity in patient subgroups. Careful consideration also needs to be given to data from multinational studies since practice patterns can differ across countries. Conclusion:Although clinical trials can be an efficient opportunity to collect data for economic evaluation, careful consideration of the suitability of the study design, and appropriate analytical methods must be applied to obtain rigorous results.

[1]  S. Crawford,et al.  A comparison of anlaytic methods for non-random missingness of outcome data. , 1995, Journal of clinical epidemiology.

[2]  M. Drummond,et al.  Collection of health-economic data alongside clinical trials: is there a future for piggyback evaluations? , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[3]  M J Buxton,et al.  Modelling in economic evaluation: an unavoidable fact of life. , 1997, Health economics.

[4]  A. Willan Statistical analysis of cost–effectiveness data from randomized clinical trials , 2006, Expert review of pharmacoeconomics & outcomes research.

[5]  Bernie J. O'Brien,et al.  In Search of Power and Significance: Issues in the Design and Analysis of Stochastic Cost-Effectiveness Studies in Health Care , 1994, Medical care.

[6]  J. Concato,et al.  Randomized, controlled trials, observational studies, and the hierarchy of research designs. , 2000, The New England journal of medicine.

[7]  D. Rubin,et al.  Reducing Bias in Observational Studies Using Subclassification on the Propensity Score , 1984 .

[8]  N. Olchanski,et al.  Growth and quality of the cost-utility literature, 1976-2001. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[9]  Andrew R Willan,et al.  'Lost in translation': accounting for between-country differences in the analysis of multinational cost-effectiveness data. , 2006, PharmacoEconomics.

[10]  B. O'brien,et al.  Challenges for Model-Based Economic Evaluations of Postmenopausal Osteoporosis Interventions , 2001, Osteoporosis International.

[11]  Michael Drummond,et al.  Assessing the appropriateness of combining economic data from multinational clinical trials , 2003, Statistics in medicine.

[12]  D. Torgerson,et al.  Bootstrapping: estimating confidence intervals for cost-effectiveness ratios. , 1999, QJM : monthly journal of the Association of Physicians.

[13]  Anthony O'Hagan,et al.  On estimators of medical costs with censored data. , 2004, Journal of health economics.

[14]  Simon G Thompson,et al.  Methods for incorporating covariate adjustment, subgroup analysis and between-centre differences into cost-effectiveness evaluations. , 2005, Health economics.

[15]  Andrew Briggs,et al.  Missing... presumed at random: cost-analysis of incomplete data. , 2003, Health economics.

[16]  Ruth Etzioni,et al.  Estimating the costs attributable to a disease with application to ovarian cancer. , 1996, Journal of clinical epidemiology.

[17]  Andrew R Willan,et al.  Regression methods for cost‐effectiveness analysis with censored data , 2005, Statistics in medicine.

[18]  E. Topol,et al.  Risk of cardiovascular events associated with selective COX-2 inhibitors. , 2001, JAMA.

[19]  Milton C Weinstein,et al.  Comparative effectiveness: asking the right questions, choosing the right method. , 2005, Health affairs.

[20]  S. Wilson Methods for the economic evaluation of health care programmes , 1987 .

[21]  G. Wilensky Developing a center for comparative effectiveness information. , 2006, Health affairs.

[22]  John Mullahy,et al.  Net Health Benefits: A New Framework for the Analysis of Uncertainty in Cost-Effectiveness Analysis , 1998 .

[23]  M. Sculpher,et al.  Assessing generalisability by location in trial-based cost-effectiveness analysis: the use of multilevel models. , 2005, Health economics.

[24]  J. Lellouch,et al.  Explanatory and pragmatic attitudes in therapeutical trials. , 1967, Journal of chronic diseases.

[25]  W. Stalman,et al.  Economic evaluation of donepezil in moderate to severe Alzheimer disease , 2005, Neurology.

[26]  E. Feuer,et al.  Estimating medical costs from incomplete follow-up data. , 1997, Biometrics.

[27]  G. Torrance,et al.  Economic evaluation of controlled-release oxycodone vs oxycodone-acetaminophen for osteoarthritis pain of the hip or knee. , 2006, The American journal of managed care.

[28]  Peter C Austin,et al.  A critical appraisal of propensity‐score matching in the medical literature between 1996 and 2003 , 2008, Statistics in medicine.

[29]  M J Al,et al.  Costs, effects and C/E-ratios alongside a clinical trial. , 1994, Health economics.

[30]  Joseph C Gardiner,et al.  Longitudinal analysis of censored medical cost data. , 2006, Health economics.

[31]  D. Stryer,et al.  Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. , 2003, JAMA.

[32]  S. Thompson,et al.  How should cost data in pragmatic randomised trials be analysed? , 2000, BMJ : British Medical Journal.

[33]  R. Willke,et al.  Estimating country-specific cost-effectiveness from multinational clinical trials. , 1998, Health economics.

[34]  D. Revicki,et al.  Pharmacoeconomic evaluation in the real world. Effectiveness versus efficacy studies. , 1999, PharmacoEconomics.

[35]  S. Shoor,et al.  Risk of acute myocardial infarction and sudden cardiac death in patients treated with cyclo-oxygenase 2 selective and non-selective non-steroidal anti-inflammatory drugs: nested case-control study , 2005, The Lancet.

[36]  A A Stinnett,et al.  Net Health Benefits , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  T. Wagner,et al.  Behavioral interventions and cost-effectiveness analysis. , 2004, Preventive medicine.

[38]  B. O'brien,et al.  Economic evaluation of pharmaceuticals. Frankenstein's monster or vampire of trials? , 1996, Medical care.

[39]  G. Torrance,et al.  Cost-effectiveness of becaplermin for nonhealing neuropathic diabetic foot ulcers. , 2003, Ostomy/wound management.

[40]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[41]  M. Drummond,et al.  A rational framework for decision making by the National Institute For Clinical Excellence (NICE) , 2002, The Lancet.

[42]  D. Torgerson,et al.  Confidence intervals for cost-effectiveness ratios: the use of 'bootstrapping'. , 1997, Journal of health services research & policy.

[43]  Mark Sculpher,et al.  Transferability of economic evaluations across jurisdictions: ISPOR Good Research Practices Task Force report. , 2009, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[44]  O Johnell,et al.  Meta-analysis of how well measures of bone mineral density predict occurrence of osteoporotic fractures. , 1996, BMJ.

[45]  Martin J Buxton,et al.  Stratified cost-effectiveness analysis: a framework for establishing efficient limited use criteria. , 2003, Health economics.

[46]  S G Thompson,et al.  Analysis and interpretation of cost data in randomised controlled trials: review of published studies , 1998, BMJ.

[47]  A. Levy,et al.  Assessing the impact of censoring of costs and effects on health-care decision-making: an example using the Atrial Fibrillation Follow-up Investigation of Rhythm Management (AFFIRM) study. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[48]  M. Drummond,et al.  An economic evaluation of sequential i.v./po moxifloxacin therapy compared to i.v./po co-amoxiclav with or without clarithromycin in the treatment of community-acquired pneumonia. , 2003, Chest.

[49]  E. Wagner,et al.  Cost-effectiveness comparisons using "real world" randomized trials: the case of new antidepressant drugs. , 1995, Journal of clinical epidemiology.

[50]  S. Sonnad,et al.  Diffusion of published cost-utility analyses in the field of health policy and practice , 2005, International Journal of Technology Assessment in Health Care.

[51]  M. Drummond,et al.  Trials and Tribulations: Emerging Issues in Designing Economic Evaluations Alongside Clinical Trials , 1998, International Journal of Technology Assessment in Health Care.

[52]  Elisabeth Fenwick,et al.  A guide to cost-effectiveness acceptability curves. , 2005, The British journal of psychiatry : the journal of mental science.

[53]  Richard Willke,et al.  Variability of cost-effectiveness estimates for pharmaceuticals in Western Europe: lessons for inferring generalizability. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[54]  B. O'brien,et al.  Cost-Effectiveness of Rhythm versus Rate Control in Atrial Fibrillation , 2004, Annals of Internal Medicine.

[55]  D Menon,et al.  Canadian Coordinating Office for Health Technology Assessment. , 1992, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[56]  A Briggs,et al.  Economic evaluation and clinical trials: size matters , 2000, BMJ : British Medical Journal.

[57]  C Michael Stein,et al.  COX-2 selective non-steroidal anti-inflammatory drugs and risk of serious coronary heart disease , 2002, The Lancet.

[58]  R. Willke,et al.  Good research practices for cost-effectiveness analysis alongside clinical trials: the ISPOR RCT-CEA Task Force report. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[59]  A. Hartz,et al.  A comparison of observational studies and randomized, controlled trials. , 2000, The New England journal of medicine.

[60]  L. Garrison,et al.  Using real-world data for coverage and payment decisions: the ISPOR Real-World Data Task Force report. , 2007, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[61]  Andrew Briggs,et al.  Cost-effectiveness acceptability curves--facts, fallacies and frequently asked questions. , 2004, Health economics.