Measuring and illustrating statistical evidence in a cost-effectiveness analysis.

Recently, there has been much interest in using the cost-effectiveness acceptability curve (CEAC) to measure the statistical evidence of cost-effectiveness. The CEAC has two well established but fundamentally different interpretations: one frequentist and one Bayesian. As an alternative, we suggest characterizing the statistical evidence about cost-effectiveness using the likelihood function (the key element of both approaches). Its interpretation is neither dependent on the sample space nor on the prior distribution. Moreover, the probability of observing misleading evidence is low and controllable, so this approach is justifiable in the traditional sense of frequentist long-run behaviour. We propose a new graphic for displaying the evidence about cost-effectiveness and explore the strengths of likelihood methods using data from an economic evaluation of a Program in Assertive Community Treatment (PACT).

[1]  R. Willke,et al.  Good research practices for cost-effectiveness analysis alongside clinical trials: the ISPOR RCT-CEA Task Force report. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[2]  Rory A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[3]  R. A. Fisher,et al.  Statistical methods and scientific inference. , 1957 .

[4]  William S. Cartwright,et al.  Methods for the economic evaluation of health care programmes, second edition. By Michael F. Drummond, Bernie O'Brien, Greg L. Stoddart, George W. Torrance. Oxford: Oxford University Press, 1997. , 1999 .

[5]  Andrew Briggs,et al.  Cost-effectiveness acceptability curves--facts, fallacies and frequently asked questions. , 2004, Health economics.

[6]  Jeffrey D Blume,et al.  Likelihood methods for measuring statistical evidence , 2002, Statistics in medicine.

[7]  L. Stein,et al.  Alternative to mental hospital treatment. III. Social cost. , 1980, Archives of general psychiatry.

[8]  Emma Sutton.  Rejoinder , 2010 .

[9]  Joseph Berkson.  Tests of significance considered as evidence , 2003 .

[10]  R. Royall.  The Effect of Sample Size on the Meaning of Significance Tests , 1986 .

[11]  J. Blume.  How to Choose a Working Model for Measuring the Statistical Evidence About a Regression Parameter , 2005 .

[12]  J. Cornfield.  Sequential Trials, Sequential Analysis and the Likelihood Principle , 1966 .

[13]  M Johannesson,et al.  A Note on Confidence Intervals in Cost-Effectiveness Analysis , 1998, International Journal of Technology Assessment in Health Care.

[14]  M J Al,et al.  Costs, effects and C/E-ratios alongside a clinical trial. , 1994, Health economics.

[15]  Jeffrey F Peipert,et al.  What your statistician never told you about P-values. , 2003, The Journal of the American Association of Gynecologic Laparoscopists.

[16]  S. P. Wright,et al.  Adjusted P-values for simultaneous inference , 1992 .

[17]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[18]  R. Royall,et al.  Measuring the Strength of Deoxyribonucleic Acid Evidence, and Probabilities of Strong Implicating Evidence , 1997 .

[19]  A F Lehman,et al.  A randomized trial of assertive community treatment for homeless persons with severe mental illness. , 1997, Archives of general psychiatry.

[20]  M. Sculpher,et al.  Representing uncertainty: the role of cost-effectiveness acceptability curves. , 2001, Health economics.

[21]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[22]  M. Drummond,et al.  Economic Evaluation in Health Care: Merging Theory with Practice , 2002 .

[23]  A Briggs,et al.  Confidence intervals or surfaces? Uncertainty on the cost-effectiveness plane. , 1998, Health economics.

[24]  John C. Hershey,et al.  Carrier Screening for Cystic Fibrosis , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[25]  R. Royall.  Statistical Evidence: A Likelihood Paradigm , 1997 .

[26]  D. Cox.  Some problems connected with statistical inference , 1958 .

[27]  A. Briggs,et al.  Cost-Effectiveness Acceptability Curves in the Dock , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[28]  J. Pratt.  Decisions as statistical evidence and Birnbaum's ‘confidence concept’ , 1977, Synthese.

[29]  B. Weisbrod,et al.  Alternative to mental hospital treatment. II. Economic benefit-cost analysis. , 1980, Archives of general psychiatry.

[30]  A. W. F. Edwards,et al.  Statistical Inference. (Book Reviews: Likelihood. An Account of the Statistical Concept of Likelihood and Its Application to Scientific Inference) , 1973 .

[31]  H. Robbins.  Statistical Methods Related to the Law of the Iterated Logarithm , 1970 .

[32]  S. Goodman,et al.  Multiple comparisons, explained. , 1998, American journal of epidemiology.

[33]  S. Altshul,et al.  Alternatives to Mental Hospital Treatment , 1979 .

[34]  R. Royall.  On the Probability of Observing Misleading Statistical Evidence , 2000 .

[35]  R. Wolpert,et al.  Likelihood Principle , 2022, The SAGE Encyclopedia of Research Design.

[36]  A A Stinnett,et al.  Net Health Benefits , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  Jerzy Neyman,et al.  First course in probability and statistics , 1951 .

[38]  Bas Groot Koerkamp,et al.  Limitations of Acceptability Curves for Presenting Uncertainty in Cost-Effectiveness Analysis , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[39]  A F Lehman,et al.  Cost-effectiveness of assertive community treatment for homeless persons with severe mental illness , 1999, British Journal of Psychiatry.

[40]  S. Goodman,et al.  Evidence and scientific research. , 1988, American journal of public health.

[41]  H. Glick,et al.  PMI10 DANCING WITH THE DEVIL: THE IMPORTANCE OF SUB-GROUP ANALYSIS IN ECONOMIC EVALUATION , 2002 .

[42]  R. Royall,et al.  Interpreting statistical evidence by using imperfect models: robust adjusted likelihood functions , 2003 .

[43]  S. Goodman,et al.  p values, hypothesis tests, and likelihood: implications for epidemiology of a neglected historical debate. , 1993, American journal of epidemiology.

[44]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[45]  M. Backhouse.  Raising the standards of trial-based economic evaluation: the devil is in the detail. , 2005, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[46]  A O'Hagan,et al.  A framework for cost-effectiveness analysis from clinical trial data. , 2001, Health economics.

[47]  N. Zethraeus,et al.  Definition, interpretation and calculation of cost-effectiveness acceptability curves. , 2000, Health economics.

[48]  M J Al,et al.  A Bayesian approach to economic analyses of clinical trials: the case of stenting versus balloon angioplasty. , 2000, Health economics.

[49]  M. Olfson.  Assertive community treatment: an evaluation of the experimental evidence. , 1990, Hospital & community psychiatry.

[50]  B J Burns,et al.  Assertive community treatment: an update of randomized trials. , 1995, Psychiatric services.

[51]  Leonard J. Savage,et al.  The foundations of statistical inference : a discussion , 1962 .

[52]  L. Dixon,et al.  Assertive community treatment and case management for schizophrenia. , 1995, Schizophrenia bulletin.

[53]  L. M. M.-T..  Theory of Probability , 1929, Nature.

[54]  M. Drummond,et al.  Health Care Technology: Effectiveness, Efficiency and Public Policy@@@Methods for the Economic Evaluation of Health Care Programmes , 1988 .

[55]  J. Blume,et al.  Statistical evidence for GLM regression parameters: A robust likelihood approach , 2007, Statistics in medicine.

[56]  H. Lamb,et al.  Persons with severe mental illness in jails and prisons: a review. , 1998, New directions for mental health services.

[57]  L. Stein,et al.  Alternative to mental hospital treatment. I. Conceptual model, treatment program, and clinical evaluation. , 1980, Archives of general psychiatry.

[58]  A. Briggs,et al.  Something old, something new, something borrowed, something blue: a framework for the marriage of health econometrics and cost-effectiveness analysis. , 2002, Health economics.

[59]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[60]  Ian Hacking.  Logic of Statistical Inference , 1965 .

[61]  S. Goodman,et al.  Toward Evidence-Based Medical Statistics. 2: The Bayes Factor , 1999, Annals of Internal Medicine.

[62]  Jeffrey S Hoch,et al.  Using the net benefit regression framework to construct cost-effectiveness acceptability curves: an example using data from a trial of external loop recorders versus Holter monitoring for ambulatory monitoring of "community acquired" syncope , 2006, BMC Health Services Research.