Exploring the Research Decision Space: The Expected Value of Information for Sequential Research Designs

Purpose. To investigate the expected value of partial perfect information (EVPPI) and the research decisions it can address. Methods. Expected value of information (EVI) analysis assesses the expected gain in net benefit from further research. Where the expected value of perfect information (EVPI) exceeds the costs of additional research, EVPPI can be used to identify parameters that contribute most to the EVPI and parameters with no EVPPI that may be disregarded as targets for further research. Recently, it was noted that parameters with low EVPPI for a one-off research design may be associated with high EVPPI when considered as part of a sequential design. This article examines the characteristics and role of conditional and sequential EVPPI in EVI analysis. Results. The calculation of EVPPI is demonstrated for single parameters, groups of parameters, and conditional and sequential EVPPI. Conditional EVPPI is the value of perfect information about one parameter, conditional on having obtained perfect information about another. Sequential EVPPI is the value of perfect information for a sequential research design to investigate first one parameter, then another. Conditional EVPPI differs from the individual EVPPI for a single parameter. Sequential EVPPI includes elements from the joint EVPPI for the parameters and the EVPPI for the first parameter in sequence. Sequential designs allow abandonment of research on the second parameter on the basis of additional information obtained on the first. Conclusions. The research decision space addressed by EVI analyses can be widened by incorporating sequential EVPPI to assess sequential research designs.

[1]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[2]  Andrew R Willan,et al.  Expected value of information and decision making in HTA. , 2007, Health economics.

[3]  Fumie Yokota,et al.  Value of Information Analysis in Environmental Health Risk Management Decisions: Past, Present, and Future , 2004, Risk analysis : an official publication of the Society for Risk Analysis.

[4]  K Claxton,et al.  The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. , 1999, Journal of health economics.

[5]  Anthony O'Hagan,et al.  Calculating Partial Expected Value of Perfect Information via Monte Carlo Sampling Algorithms , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  John D. Graham,et al.  Going beyond the single number: Using probabilistic risk assessment to improve risk management , 1996 .

[7]  Fumie Yokota,et al.  Value of Information Literature Analysis: A Review of Applications in Health Risk Management , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  Karl Claxton,et al.  Dimensions of Design Space: A Decision-Theoretic Approach to Optimal Research Design , 2009, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  J. Evans,et al.  Assessing the value of hydrogeologic information for risk‐based remedial action decisions , 1989 .

[10]  Gordon B. Hazen,et al.  Sensitivity Analysis and the Expected Value of Perfect Information , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  Karl Claxton,et al.  A Pilot Study of Value of Information Analysis to Support Research Recommendations for the National Institute for Health and Clinical Excellence , 2005 .

[12]  M C Weinstein,et al.  Bayesian value-of-information analysis. An application to a policy model of Alzheimer's disease. , 2001, International journal of technology assessment in health care.

[13]  D. C. Cox,et al.  Methods for Uncertainty Analysis: A Comparative Survey , 1981 .

[14]  A E Ades,et al.  Expected Value of Sample Information Calculations in Medical Decision Modeling , 2004, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Maxine E. Dakins The Value of the Value of Information , 1999 .

[16]  M Sculpher,et al.  A pilot study on the use of decision theory and value of information analysis as part of the NHS Health Technology Assessment programme. , 2004, Health technology assessment.

[17]  Stephen Palmer,et al.  The Half-Life of Truth: What Are Appropriate Time Horizons for Research Decisions? , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[18]  M. Sculpher,et al.  Decision Modelling for Health Economic Evaluation , 2006 .

[19]  Mitchell J. Small,et al.  Updating Uncertainty in an Integrated Risk Assessment: Conceptual Framework and Methods , 1995 .

[20]  A A Stinnett,et al.  Net Health Benefits , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  Stephen C. Peck,et al.  Managing Uncertainty: The Tropospheric Ozone Challenge , 1994 .

[22]  Deborah M Caldwell,et al.  Research prioritization based on expected value of partial perfect information: a case‐study on interventions to increase uptake of breast cancer screening , 2008 .

[23]  Mark J Sculpher,et al.  Dangerous omissions: the consequences of ignoring decision uncertainty. , 2011, Health economics.