Value of Information of a clinical prediction rule: Informing the efficient use of healthcare and health research resources

Objectives: The aim of this study was to estimate the potential cost-effectiveness and expected value of perfect information of a recently derived clinical prediction rule for patients presenting to emergency departments with chest discomfort. Methods: A decision analytic model was constructed to compare the Early Disposition Prediction Rule (EDPR) with the current standard of care. Results were used to calculate the potential cost-effectiveness of the EDPR, as well as the Value of Information in conducting further research. Study subjects were adults presenting with chest discomfort to two urban emergency departments in Vancouver, British Columbia, Canada. The clinical prediction rule identifies patients who are eligible for early discharge within 3 hours of presentation to the emergency department. The outcome measure used was inappropriate emergency department discharge of patients with acute coronary syndrome (ACS). Results: The incremental cost-effectiveness ratio of the EDPR in comparison to usual care was (negative) $2,999 per inappropriate ACS discharge prevented, indicating a potential cost-savings in introducing the intervention. The expected value of perfect information was $16.3 million in the first year of implementation, suggesting a high benefit from conducting further research to validate the decision rule. Conclusions: The EDPR is likely to be cost-effective; however, given the high degree of uncertainty in the estimates of costs and patient outcomes, further research is required to inform the decision to implement the intervention. The potential health and monetary benefits of this clinical prediction rule outweigh the costs of doing further research.

[1]  John C. Hershey,et al.  Carrier Screening for Cystic Fibrosis , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  S. Wilson Methods for the economic evaluation of health care programmes , 1987 .

[3]  Eugenia Yu,et al.  A clinical prediction rule for early discharge of patients with chest pain. , 2006, Annals of emergency medicine.

[4]  R B D'Agostino,et al.  The usefulness of a predictive instrument to reduce inappropriate admissions to the coronary care unit. , 1980, Annals of internal medicine.

[5]  John Mullahy,et al.  Net Health Benefits: A New Framework for the Analysis of Uncertainty in Cost-Effectiveness Analysis , 1998 .

[6]  Rachel L Knowles,et al.  Comparing the clinical and economic effects of clinical examination, pulse oximetry, and echocardiography in newborn screening for congenital heart defects: A probabilistic cost-effectiveness model and value of information analysis , 2007, International Journal of Technology Assessment in Health Care.

[7]  Peter A Ubel,et al.  What is the price of life and why doesn't it increase at the rate of inflation? , 2003, Archives of internal medicine.

[8]  R. D'Agostino,et al.  A comparison of performance of mathematical predictive methods for medical diagnosis: identifying acute cardiac ischemia among emergency department patients. , 1995, Journal of investigative medicine : the official publication of the American Federation for Clinical Research.

[9]  Bas Groot Koerkamp,et al.  Identifying key parameters in cost-effectiveness analysis using value of information: a comparison of methods. , 2006, Health economics.

[10]  G. L. Higgins,et al.  A randomized trial of the effects of early cardiac serum marker availability on reperfusion therapy in patients with acute myocardial infarction: the serial markers, acute myocardial infarction and rapid treatment trial (SMARTT). , 2000, Journal of the American College of Cardiology.

[11]  Doug Coyle,et al.  Value of information analysis for a new technology: Computer-assisted total knee replacement , 2007, International Journal of Technology Assessment in Health Care.

[12]  Jeffrey A. Stem,et al.  A computer-derived protocol to aid in the diagnosis of emergency room patients with acute chest pain. , 1982, The New England journal of medicine.

[13]  Douglas K. Martin,et al.  Evidence, economics and ethics: resource allocation in health services organizations. , 2005, Healthcare quarterly.

[14]  Robert Woolard,et al.  Missed Diagnoses of Acute Cardiac Ischemia in the Emergency Department , 2000 .

[15]  E. Fody,et al.  The Erlanger chest pain evaluation protocol: a one-year experience with serial 12-lead ECG monitoring, two-hour delta serum marker measurements, and selective nuclear stress testing to identify and exclude acute coronary syndromes. , 2002, Annals of emergency medicine.

[16]  B. McNeil,et al.  Probabilistic Sensitivity Analysis Using Monte Carlo Simulation , 1985, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  J P Ornato,et al.  Use of the Acute Cardiac Ischemia Time-Insensitive Predictive Instrument (ACI-TIPI) To Assist with Triage of Patients with Chest Pain or Other Symptoms Suggestive of Acute Cardiac Ischemia: A Multicenter, Controlled Clinical Trial , 1998, Annals of Internal Medicine.

[18]  E F Cook,et al.  A computer protocol to predict myocardial infarction in emergency department patients with chest pain. , 1988, The New England journal of medicine.

[19]  A. Gafni,et al.  Incremental cost-effectiveness ratios (ICERs): the silence of the lambda. , 2006, Social science & medicine.

[20]  M. Drummond,et al.  A rational framework for decision making by the National Institute For Clinical Excellence (NICE) , 2002, The Lancet.

[21]  A S Detsky,et al.  How attractive does a new technology have to be to warrant adoption and utilization? Tentative guidelines for using clinical and economic evaluations. , 1992, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[22]  N. Bansback,et al.  Cost-effectiveness of surgery plus radiotherapy versus radiotherapy alone for metastatic epidural spinal cord compression. , 2006, International journal of radiation oncology, biology, physics.

[23]  W. Groot,et al.  The compensating income variation of cardiovascular disease. , 2006, Health economics.

[24]  W. Gibler,et al.  Combination of Goldman risk and initial cardiac troponin I for emergency department chest pain patient risk stratification. , 2001, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[25]  R Ruthazer,et al.  Missed diagnoses of acute cardiac ischemia in the emergency department. , 2000, The New England journal of medicine.

[26]  K. Liestøl,et al.  Prospective evaluation of an EDB-based diagnostic program to be used in patients admitted to hospital with acute chest pain. , 1993, European heart journal.

[27]  R B D'Agostino,et al.  A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. A prospective multicenter clinical trial. , 1984, The New England journal of medicine.

[28]  Craig Mitton,et al.  Priority setting in health authorities: a novel approach to a historical activity. , 2003, Social science & medicine.

[29]  K Claxton,et al.  The irrelevance of inference: a decision-making approach to the stochastic evaluation of health care technologies. , 1999, Journal of health economics.

[30]  J. Singer,et al.  Safety and efficiency of emergency department assessment of chest discomfort , 2004, Canadian Medical Association Journal.

[31]  A. Briggs,et al.  Probabilistic Sensitivity Analysis for Decision Trees with Multiple Branches: Use of the Dirichlet Distribution in a Bayesian Framework , 2003, Medical decision making : an international journal of the Society for Medical Decision Making.

[32]  R. D'Agostino,et al.  A predictive instrument for acute ischemic heart disease to improve coronary care unit admission practices: a potential on-line tool in a computerized electrocardiograph. , 1988, Journal of electrocardiology.