Measuring Decision Sensitivity

Modeling of the uncertainty of multiple input variables for a complex decision problem com plicates sensitivity analysis. A method of analysis comprising stochastic simulation of the model and logistic regression of the simulated dichotomous decision variable against all of the input variables yields a direct measure of the importance of input variables to the decision. This method is demonstrated on a previously analyzed clinical decision either to continue observation or to immediately treat with anticoagulants a woman presenting with deep vein thrombosis in the first trimester of pregnancy. A relative measure of the importance of each input variable in causing a change of decision is estimated by calculating the change in the log odds attributable to variation of each input variable over its range of uncertain values compared with the total change of log odds from variation of all input variables. This method is compared with alternative measures of input variable importance, and is found to be a simple yet powerful tool for gaining quantitative insight into the nuances of a decision model. Key words: decision sensitivity; logistic regression; decision model; Monte Carlo technique. (Med Decis Making 1992;12:189-196)

[1]  Max Henrion,et al.  Uncertainty: A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis , 1990 .

[2]  G. Hripcsak Using Connectionist Modules for Decision Support , 1990, Methods of Information in Medicine.

[3]  Stephen E. Fienberg,et al.  The analysis of cross-classified categorical data , 1980 .

[4]  K E Willard,et al.  Probabilistic Analysis of Decision Trees Using Monte Carlo Simulation , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[5]  S G Pauker Decision analysis as a synthetic tool for achieving consensus in technology assessment. , 1986, International journal of technology assessment in health care.

[6]  T. Pass,et al.  III. the Physician's Office and Group Practice—Ambulatory Medical Record Systems: F. Practice Review and Quality of Care: CE-TREE: A Computerized Aid for Medical Cost-Effectiveness Analysis , 1981 .

[7]  M. Weinstein,et al.  Clinical Decision Analysis , 1980 .

[8]  S G Pauker,et al.  Recurrent deep venous thrombosis in pregnancy. Analysis of the risks and benefits of anticoagulation. , 1981, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  S. Hui,et al.  Variance estimation for medical decision analysis. , 1989, Statistics in medicine.

[10]  Contribution of medical decision-making to consensus development conferences. , 1987, Health policy.

[11]  J. Neter,et al.  Applied linear statistical models : regression, analysis of variance, and experimental designs , 1974 .

[12]  K E Willard,et al.  Probabilistic Analysis of Decision Trees Using Symbolic Algebra , 1986, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  J. Merz An Empirical Analysis of the Medical Informed Consent Doctrine: Search for a Standard of Disclosure , 1991 .

[15]  R. Spear Eutrophication in peel inlet—II. Identification of critical uncertainties via generalized sensitivity analysis , 1980 .

[16]  Walter L. Smith Probability and Statistics , 1959, Nature.

[17]  J. Kassirer,et al.  The threshold approach to clinical decision making. , 1980, The New England journal of medicine.

[18]  R. Rifkin,et al.  Statistical Considerations in Medical Decision Models , 1983, Medical decision making : an international journal of the Society for Medical Decision Making.

[19]  S. R. Watson,et al.  Decision Synthesis: The Principles and Practice of Decision Analysis@@@Strategic and Tactical Decisions , 1989 .

[20]  Jon Frederick Merz Toward a standard of disclosure for medical informed consent : development and demonstration of a decision-analytic methodology , 1991 .

[21]  B. McNeil,et al.  Probabilistic Sensitivity Analysis Using Monte Carlo Simulation , 1985, Medical decision making : an international journal of the Society for Medical Decision Making.