Economic evaluation of factorial randomised controlled trials: challenges, methods and recommendations

Increasing numbers of economic evaluations are conducted alongside randomised controlled trials. Such studies include factorial trials, which randomise patients to different levels of two or more factors and can therefore evaluate the effect of multiple treatments alone and in combination. Factorial trials can provide increased statistical power or assess interactions between treatments, but raise additional challenges for trial‐based economic evaluations: interactions may occur more commonly for costs and quality‐adjusted life‐years (QALYs) than for clinical endpoints; economic endpoints raise challenges for transformation and regression analysis; and both factors must be considered simultaneously to assess which treatment combination represents best value for money. This article aims to examine issues associated with factorial trials that include assessment of costs and/or cost‐effectiveness, describe the methods that can be used to analyse such studies and make recommendations for health economists, statisticians and trialists. A hypothetical worked example is used to illustrate the challenges and demonstrate ways in which economic evaluations of factorial trials may be conducted, and how these methods affect the results and conclusions. Ignoring interactions introduces bias that could result in adopting a treatment that does not make best use of healthcare resources, while considering all interactions avoids bias but reduces statistical power. We also introduce the concept of the opportunity cost of ignoring interactions as a measure of the bias introduced by not taking account of all interactions. We conclude by offering recommendations for planning, analysing and reporting economic evaluations based on factorial trials, taking increased analysis costs into account. © 2017 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.

[1]  N J Welton,et al.  A Bayesian approach to analysing the cost-effectiveness of two primary care interventions aimed at improving attendance for breast screening. , 2006, Health economics.

[2]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[3]  Sarah Darby,et al.  Lung cancer deaths from indoor radon and the cost effectiveness and potential of policies to reduce them , 2009, BMJ : British Medical Journal.

[4]  Richard F. Gunst,et al.  Regression and ANOVA: An Integrated Approach Using SAS Software , 2003, Technometrics.

[5]  Frank A. Sloan,et al.  Valuing health care : costs, benefits, and effectiveness of pharmaceuticals and other medical technologies , 1995 .

[6]  W. Manning Dealing with Skewed Data on Costs and Expenditures , 2006 .

[7]  M. Johannesson,et al.  Theory and methods of economic evaluation of health care. , 1996, Developments in health economics and public policy.

[8]  Douglas G Altman,et al.  Analysis and reporting of factorial trials: a systematic review. , 2003, JAMA.

[9]  Martin J Buxton,et al.  Stratified cost-effectiveness analysis: a framework for establishing efficient limited use criteria. , 2003, Health economics.

[10]  D. Couper,et al.  Factorial designs in clinical trials: options for combination treatment studies. , 2005, Journal of studies on alcohol. Supplement.

[11]  M. Sculpher,et al.  Decision Modelling for Health Economic Evaluation , 2006 .

[12]  Karl Claxton,et al.  The Value of Heterogeneity for Cost-Effectiveness Subgroup Analysis , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  S. Jowett,et al.  Joint protection and hand exercises for hand osteoarthritis: an economic evaluation comparing methods for the analysis of factorial trials , 2014, Rheumatology.

[14]  David Moher,et al.  Consolidated Health Economic Evaluation Reporting Standards (CHEERS)--explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[15]  A Briggs,et al.  Economic evaluation and clinical trials: size matters , 2000, BMJ : British Medical Journal.

[16]  P. Clarke,et al.  Comprar Applied Methods of Cost-effectiveness Analysis in Healthcare | Alastair M. Gray | 9780199227280 | Oxford University Press , 2010 .

[17]  S. Piantadosi,et al.  Factorial designs for randomized clinical trials. , 1985, Cancer treatment reports.

[18]  M. Sculpher,et al.  Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. , 2005, Health economics.

[19]  P. Dolan,et al.  Modeling valuations for EuroQol health states. , 1997, Medical care.

[20]  Milton C. Weinstein,et al.  Valuing health care: From cost–effectiveness ratios to resource allocation: where to draw the line? , 1995 .

[21]  M. Johannesson,et al.  Cost-utility analysis from a societal perspective. , 1997, Health policy.

[22]  Andrew R Willan,et al.  The value of information and optimal clinical trial design , 2005, Statistics in medicine.

[23]  R Simon,et al.  Bayesian design and analysis of two x two factorial clinical trials. , 1997, Biometrics.

[24]  Ilias Goranitis,et al.  Economic evaluation alongside factorial trials: a systematic review of empirical studies. , 2015, Expert review of pharmacoeconomics & outcomes research.

[25]  Stephanie Green,et al.  Factorial Designs with Time-to-Event Endpoints , 2012 .

[26]  M Johannesson,et al.  On the decision rules of cost-effectiveness analysis. , 1993, Journal of health economics.

[27]  L. Gluud,et al.  Antioxidant supplements for prevention of mortality in healthy participants and patients with various diseases. , 2008, The Cochrane database of systematic reviews.

[28]  A. Briggs,et al.  Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. , 2002, Health economics.

[29]  M. Boyle,et al.  Multiattribute and Single‐Attribute Utility Functions for the Health Utilities Index Mark 3 System , 2002, Medical care.

[30]  Andrew Briggs,et al.  Statistical Analysis of Cost-Effectiveness Data , 2006 .

[31]  Sally Hopewell,et al.  The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed , 2010, BMJ : British Medical Journal.

[32]  R. Willke,et al.  Cost-effectiveness analysis alongside clinical trials II-An ISPOR Good Research Practices Task Force report. , 2015, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[33]  S. Kenyon,et al.  Childhood outcomes after prescription of antibiotics to pregnant women with spontaneous preterm labour: 7-year follow-up of the ORACLE II trial , 2008, The Lancet.

[34]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[35]  S. Wilson Methods for the economic evaluation of health care programmes , 1987 .

[36]  T J Ulahannan,et al.  Decision Making in Health and Medicine: Integrating Evidence and Values , 2002 .

[37]  K Claxton,et al.  The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. , 1999, Journal of health economics.

[38]  R T O'Neill,et al.  Efficacy evaluation for monotherapies in two-by-two factorial trials. , 1995, Biometrics.

[39]  S. Thompson,et al.  Multiple regression of cost data: use of generalised linear models , 2004, Journal of health services research & policy.

[40]  M. Weinstein,et al.  Foundations of cost-effectiveness analysis for health and medical practices. , 1977, The New England journal of medicine.

[41]  A. Briggs,et al.  Statistical Analysis of Cost-effectiveness Data: Willan/Statistical Analysis of Cost-effectiveness Data , 2006 .

[42]  Grazyna Adamiak,et al.  Methods for the economic evaluation of health care programmes, 3rd ed , 2006 .

[43]  Deborah M Caldwell,et al.  Research prioritization based on expected value of partial perfect information: a case‐study on interventions to increase uptake of breast cancer screening , 2008 .

[44]  Andrew R Willan,et al.  Expected value of information and decision making in HTA. , 2007, Health economics.

[45]  R. Grieve,et al.  Non-parametric methods for cost-effectiveness analysis: the central limit theorem and the bootstrap compared. , 2010, Health economics.

[46]  S. Pocock,et al.  Factorial trials in cardiology: pros and cons. , 1994, European heart journal.

[47]  J. Wittes,et al.  Factorial designs in clinical trials: the effects of non-compliance and subadditivity. , 1989, Statistics in medicine.

[48]  Andrew R Willan,et al.  Regression methods for covariate adjustment and subgroup analysis for non-censored cost-effectiveness data. , 2004, Health economics.

[49]  D P Byar Factorial and reciprocal control designs. , 1990, Statistics in medicine.

[50]  Tie-Hua Ng,et al.  The impact of a preliminary test for interaction in a 2 × 2 factorial trial , 1994 .

[51]  Andrew Briggs,et al.  Lifetime cost effectiveness of simvastatin in a range of risk groups and age groups derived from a randomised trial of 20 536 people , 2006, BMJ : British Medical Journal.

[52]  Jalpa A Doshi,et al.  Analyses of cost data in economic evaluations conducted alongside randomized controlled trials. , 2006, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[53]  Stavros Petrou,et al.  Economic evaluation alongside randomised controlled trials: design, conduct, analysis, and reporting , 2011, BMJ : British Medical Journal.

[54]  Simon G Thompson,et al.  Methods for incorporating covariate adjustment, subgroup analysis and between-centre differences into cost-effectiveness evaluations. , 2005, Health economics.

[55]  Sarah Wordsworth,et al.  Applied Methods of Cost-Effectiveness Analysis in Healthcare , 2010 .

[56]  Alan A Montgomery,et al.  Design, analysis and presentation of factorial randomised controlled trials , 2003, BMC medical research methodology.

[57]  Andrea Manca,et al.  Regression Estimators for Generic Health-Related Quality of Life and Quality-Adjusted Life Years , 2012, Medical decision making : an international journal of the Society for Medical Decision Making.

[58]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2011, BMJ : British Medical Journal.

[59]  S. Bryan,et al.  Incorporating external evidence in trial-based cost-effectiveness analyses: the use of resampling methods , 2012, Trials.

[60]  Stephen S. Lim,et al.  Methods to assess the costs and health effects of interventions for improving health in developing countries , 2005, BMJ : British Medical Journal.

[61]  C. Silagy,et al.  Review of 39 years of randomized controlled trials in the British Journal of General Practice. , 1994, The British journal of general practice : the journal of the Royal College of General Practitioners.

[62]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[63]  A Briggs,et al.  Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. , 1998, Health economics.

[64]  H M Hung Two-stage tests for studying monotherapy and combination therapy in two-by-two factorial trials. , 1993, Statistics in medicine.

[65]  M. Sculpher,et al.  Representing uncertainty: the role of cost-effectiveness acceptability curves. , 2001, Health economics.

[66]  D. Purdie Statistical Methods in Medical Research, 4th edn , 2003 .

[67]  A H Briggs,et al.  Pulling cost-effectiveness analysis up by its bootstraps: a non-parametric approach to confidence interval estimation. , 1997, Health economics.

[68]  Rory A. Fisher,et al.  The Arrangement of Field Experiments , 1992 .

[69]  M. Drummond,et al.  Whither trial-based economic evaluation for health care decision making? , 2006, Health economics.

[70]  A. Rothberg Making Choices in Health: WHO Guide to Cost Effectiveness Analysis , 2008 .

[71]  Roberta Ara,et al.  Tails from the peak district: adjusted limited dependent variable mixture models of EQ-5D questionnaire health state utility values. , 2012, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.