Value of information analyses of economic randomized controlled trials: the treatment of intermittent claudication.

OBJECTIVE The aim of this study is to design the optimal study comparing endovascular revascularization and supervised exercise training for patients with intermittent claudication and to demonstrate value of information (VOI) analysis of patient-level data from an economic randomized controlled trial to guide future research. METHODS We applied a net benefit framework to patient-level data on costs and quality-of-life of a previous randomized controlled trial. VOI analyses were performed using Monte Carlo simulation. We estimated the total expected value of perfect information (total EVPI), the total expected value of sample information (total EVSI), the partial expected value of perfect information (partial EVPI), and the partial expected value of sample information (partial EVSI). These VOI analyses identified the key parameters and the optimal sample size of future study designs. Sensitivity analyses were performed to explore the robustness of our assumptions about the population to benefit, the willingness-to-pay threshold, and the study costs. The VOI analyses are demonstrated in statistical software (R) and a spreadsheet (Excel) allowing other investigators to apply VOI analysis to their patient-level data. RESULTS The optimal study design for the treatment of intermittent claudication involves a randomized controlled trial collecting data on the quality-adjusted life expectancy and additional admission costs for 525 patients per treatment arm. The optimal sample size remained between 400 and 600 patients for a willingness-to-pay threshold between euro30,000 and euro100,000/quality-adjusted life-years, for even extreme assumptions about the study costs, and for a range of 3 to 7 years that future patients will benefit from the results of the proposed study. CONCLUSIONS 1) The optimal study for patients with intermittent claudication collects data on two key parameters for 525 patients per trial arm; and 2) we have shown that value of information analysis provides an explicit framework to determine the optimal sample size and identify key parameters for the design of future clinical trials.

[1]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[2]  T C Chalmers,et al.  The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials. , 1978, The New England journal of medicine.

[3]  R. Willke,et al.  Good research practices for cost-effectiveness analysis alongside clinical trials: the ISPOR RCT-CEA Task Force report. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[4]  D G Altman,et al.  Statistics notes: Absence of evidence is not evidence of absence , 1995 .

[5]  Sue Eckstein,et al.  Good research practice , 2003 .

[6]  T. W. Anderson.  An Introduction to Multivariate Statistical Analysis , 1959 .

[7]  K M Thompson,et al.  A dynamic programming approach to the efficient design of clinical trials. , 2001, Journal of health economics.

[8]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[9]  M. J. R. Healy,et al.  Economic Choice of the Amount of Experimentation , 1956 .

[10]  H G Korvin,et al.  Intermittent claudication. , 1971, British medical journal.

[11]  R. Rutherford,et al.  Management of peripheral arterial disease (PAD). TASC Working Group. TransAtlantic Inter-Society Consensus (TASC). , 2000, Journal of vascular surgery.

[12]  R. Pierce-Brown,et al.  The economics of Accounting for Growth , 1999 .

[13]  John Mullahy,et al.  Net Health Benefits: A New Framework for the Analysis of Uncertainty in Cost-Effectiveness Analysis , 1998 .

[14]  Fumie Yokota,et al.  Value of Information Literature Analysis: A Review of Applications in Health Risk Management , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Ruth Etzioni,et al.  Cost effectiveness of lung-volume-reduction surgery for patients with severe emphysema. , 2003, The New England journal of medicine.

[16]  A. Detsky,et al.  Are clinical trials a cost-effective investment? , 1989, JAMA.

[17]  KolliSandeep,et al.  A dynamic programming approach , 2011 .

[18]  Andrew R Willan,et al.  Clinical decision making and the expected value of information , 2007, Clinical trials.

[19]  J. Hubera,et al.  The value of information and optimal trading strategies in markets with heterogeneously informed traders # , 2003 .

[20]  C Poole,et al.  More research is needed. , 1999, Annals of epidemiology.

[21]  M. Hunink,et al.  Cost-effectiveness of endovascular revascularization compared to supervised hospital-based exercise training in patients with intermittent claudication: a randomized controlled trial. , 2008, Journal of vascular surgery.

[22]  D G Altman,et al.  Absence of evidence is not evidence of absence. , 1996, Australian veterinary journal.

[23]  K Claxton,et al.  An economic approach to clinical trial design and research priority-setting. , 1996, Health economics.

[24]  M Sculpher,et al.  A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. , 2004, Health technology assessment.

[25]  C V Phillips,et al.  The economics of 'more research is needed'. , 2001, International journal of epidemiology.

[26]  J. Wong,et al.  Intermittent claudication: cost-effectiveness of revascularization versus exercise therapy. , 2002, Radiology.

[27]  Andrew Briggs,et al.  The credibility of health economic models for health policy decision-making: the case of population screening for abdominal aortic aneurysm , 2007, Journal of health services research & policy.

[28]  A S Detsky,et al.  Using cost-effectiveness analysis to improve the efficiency of allocating funds to clinical trials. , 1990, Statistics in medicine.

[29]  Andrew R Willan,et al.  The value of information and optimal clinical trial design , 2005, Statistics in medicine.

[30]  A. W. Musschenga.  Zinnige en duurzame zorg , 2007 .

[31]  T. Murphy,et al.  Aortoiliac insufficiency: long-term experience with stent placement for treatment. , 2004, Radiology.

[32]  M. Drummond,et al.  A rational framework for decision making by the National Institute For Clinical Excellence (NICE) , 2002, The Lancet.

[33]  A E Ades,et al.  Expected Value of Sample Information Calculations in Medical Decision Modeling , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[34]  John C. Hershey,et al.  Carrier Screening for Cystic Fibrosis , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[35]  M. Hunink,et al.  Intermittent claudication: clinical effectiveness of endovascular revascularization versus supervised hospital-based exercise training--randomized controlled trial. , 2009, Radiology.