The Curve of Optimal Sample Size (COSS): A Graphical Representation of the Optimal Sample Size from a Value of Information Analysis

Value of information (VOI) analysis quantifies the opportunity cost associated with decision uncertainty, and thus informs the value of collecting further information to avoid this cost. VOI can inform study design, optimal sample size selection, and research prioritization. Recent methodological advances have reduced the computational burden of conducting VOI analysis and have made it easier to evaluate the expected value of sample information, the expected net benefit of sampling, and the optimal sample size of a study design ($$n^{*}$$n∗). The volume of VOI analyses being published is increasing, and there is now a need for VOI studies to conduct sensitivity analyses on VOI-specific parameters. In this practical application, we introduce the curve of optimal sample size (COSS), which is a graphical representation of $$n^{*}$$n∗ over a range of willingness-to-pay thresholds and VOI parameters (example data and R code are provided). In a single figure, the COSS presents summary data for decision makers to determine the sample size that optimizes research funding given their operating characteristics. The COSS also presents variation in the optimal sample size given variability or uncertainty in VOI parameters. The COSS represents an efficient and additional approach for summarizing results from a VOI analysis.

[1]  M. Sculpher,et al.  Decision Modelling for Health Economic Evaluation , 2006 .

[2]  Jeremy E. Oakley,et al.  Estimating the Expected Value of Sample Information Using the Probabilistic Sensitivity Analysis Sample , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[3]  R. Walensky,et al.  Implementing Generalized Additive Models to Estimate the Expected Value of Sample Information in a Microsimulation Model: Results of Three Case Studies , 2017, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  Haitham W Tuffaha,et al.  Value of information analysis in healthcare: a review of principles and applications , 2014, Journal of medical economics.

[5]  P. Scuffham,et al.  Value of information analysis in oncology: the value of evidence and evidence of value. , 2014, Journal of oncology practice.

[6]  Hyon K. Choi,et al.  Prioritizing Future Research on Allopurinol and Febuxostat for the Management of Gout: Value of Information Analysis , 2017, PharmacoEconomics.

[7]  Hyon K. Choi,et al.  Cost-Effectiveness of Allopurinol and Febuxostat for the Management of Gout , 2014, Annals of Internal Medicine.

[8]  W. Bilker,et al.  Gout epidemiology: results from the UK General Practice Research Database, 1990–1999 , 2005, Annals of the rheumatic diseases.

[9]  R. Wortmann,et al.  Increasing prevalence of gout and hyperuricemia over 10 years among older adults in a managed care population. , 2004, The Journal of rheumatology.

[10]  Matthew Kowgier,et al.  Determining optimal sample sizes for multi-stage randomized clinical trials using value of information methods , 2008, Clinical trials.

[11]  Hawre Jalal,et al.  Computing Expected Value of Partial Sample Information from Probabilistic Sensitivity Analysis Using Linear Regression Metamodeling , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  Andrew R Willan,et al.  Optimal sample size determinations from an industry perspective based on the expected value of information , 2008, Clinical trials.

[13]  Andrew R Willan,et al.  Time and expected value of sample information wait for no patient. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[14]  Andrew R Willan,et al.  The value of information and optimal clinical trial design , 2005, Statistics in medicine.

[15]  E. Wilson A Practical Guide to Value of Information Analysis , 2015, PharmacoEconomics.

[16]  Andrew R Willan,et al.  Optimal clinical trial design using value of information methods with imperfect implementation. , 2009, Health economics.

[17]  Andrew R Willan,et al.  Expected value of information and decision making in HTA. , 2007, Health economics.

[18]  Fernando Alarid-Escudero,et al.  A Gaussian Approximation Approach for Value of Information Analysis , 2017, Medical decision making : an international journal of the Society for Medical Decision Making.

[19]  Stephen Palmer,et al.  The Half-Life of Truth: What Are Appropriate Time Horizons for Research Decisions? , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[20]  E. Emanuel,et al.  The costs of conducting clinical research. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[21]  K Claxton,et al.  An economic approach to clinical trial design and research priority-setting. , 1996, Health economics.

[22]  N. Menzies An Efficient Estimator for the Expected Value of Sample Information , 2016, Medical decision making : an international journal of the Society for Medical Decision Making.

[23]  P. Scuffham,et al.  Value of Information Analysis Informing Adoption and Research Decisions in a Portfolio of Health Care Interventions , 2016, MDM policy & practice.

[24]  M. Mcgrath Cost Effectiveness in Health and Medicine. , 1998 .

[25]  S. Gabriel,et al.  Epidemiology of gout: is the incidence rising? , 2002, The Journal of rheumatology.

[26]  J. Madan,et al.  Strategies for Efficient Computation of the Expected Value of Partial Perfect Information , 2014, Medical decision making : an international journal of the Society for Medical Decision Making.

[27]  Susi Sadler,et al.  Cost-effectiveness of screening for ovarian cancer amongst postmenopausal women: a model-based economic evaluation , 2016, BMC Medicine.

[28]  Wade S. Smith,et al.  Effect of a US National Institutes of Health programme of clinical trials on public health and costs , 2006, The Lancet.

[29]  P. Scuffham,et al.  Value of information analysis optimizing future trial design from a pilot study on catheter securement devices , 2014, Clinical trials.

[30]  Gianluca Baio,et al.  Bayesian Cost-Effectiveness Analysis with the R package BCEA , 2017 .

[31]  Gianluca Baio,et al.  Efficient Monte Carlo Estimation of the Expected Value of Sample Information Using Moment Matching , 2016, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  Jeremy E. Oakley,et al.  Estimating Multiparameter Partial Expected Value of Perfect Information from a Probabilistic Sensitivity Analysis Sample , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[33]  Hyon K. Choi,et al.  Prevalence of gout and hyperuricemia in the US general population: the National Health and Nutrition Examination Survey 2007-2008. , 2011, Arthritis and rheumatism.

[34]  V. Retèl,et al.  A Systematic and Critical Review of the Evolving Methods and Applications of Value of Information in Academia and Practice , 2012, PharmacoEconomics.

[35]  A E Ades,et al.  Expected Value of Sample Information Calculations in Medical Decision Modeling , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[36]  Gianluca Baio,et al.  A Review of Methods for Analysis of the Expected Value of Information , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.