Internal validation of models with several interventions

In cost-effectiveness analyses, models are used typically to synthesize the best available data and/or extrapolate beyond clinical trial data. Ideally, models should be validated both internally and externally. The purpose of this paper is to suggest a test for internal validation of models where several interventions for the same clinical indication are compared. To the best of our knowledge, such a specific test does not yet exist. There are four versions of the test, which consider the relationship between incremental downstream costs and effects in the case of a single or several endpoints. We apply two versions of the validation test to published cost-effectiveness analyses of physical activity programs and demonstrate internal validity of the model in one study and lack of internal validity of the model in the other study.

[1]  T. Wright,et al.  Policy analysis of cervical cancer screening strategies in low-resource settings: clinical benefits and cost-effectiveness. , 2001, JAMA.

[2]  A. Gafni,et al.  Changing the problem to fit the solution: Johannesson and Weinstein's (mis) application of economics to real world problems. , 1993, Journal of health economics.

[3]  Richard J. Zeckhauser,et al.  Critical ratios and efficient allocation , 1973 .

[4]  J Chilcott,et al.  Avoiding and identifying errors in health technology assessment models: qualitative study and methodological review. , 2010, Health technology assessment.

[5]  C. Knight,et al.  Cost-utility analysis of varenicline versus existing smoking cessation strategies using the BENESCO Simulation model: application to a population of US adult smokers. , 2008, PharmacoEconomics.

[6]  B. O'brien,et al.  Economic evaluation of outpatient treatment with low-molecular-weight heparin for proximal vein thrombosis. , 1999, Archives of internal medicine.

[7]  B E Ainsworth,et al.  Compendium of physical activities: an update of activity codes and MET intensities. , 2000, Medicine and science in sports and exercise.

[8]  Milton C Weinstein,et al.  Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR Task Force on Good Research Practices--Modeling Studies. , 2003, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[9]  M. Airoldi,et al.  Adjusting life for quality or disability: stylistic difference or substantial dispute? , 2009, Health economics.

[10]  M. Pratt,et al.  Cost effectiveness of community-based physical activity interventions. , 2008, American journal of preventive medicine.

[11]  J A Mauskopf,et al.  Estimating Costs in A Cost-Effectiveness Analysis: Adherence to HTA Guidance. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[12]  Sarah Wordsworth,et al.  Applied Methods of Cost-Effectiveness Analysis in Healthcare , 2010 .

[13]  V. Hasselblad,et al.  Cost-effectiveness of the clinical practice recommendations in the AHCPR guideline for smoking cessation. Agency for Health Care Policy and Research. , 1997, JAMA.

[14]  Stephen W. Sorensen,et al.  The Cost-Effectiveness of Lifestyle Modification or Metformin in Preventing Type 2 Diabetes in Adults with Impaired Glucose Tolerance , 2005, Annals of Internal Medicine.

[15]  D R Holtgrave,et al.  Threshold Analysis and Programs for Prevention of HIV Infection , 1995, Medical decision making : an international journal of the Society for Medical Decision Making.

[16]  M Sculpher,et al.  Health Technology Assessment: Development and Future , 2009 .

[17]  M J Buxton,et al.  Modelling in economic evaluation: an unavoidable fact of life. , 1997, Health economics.

[18]  T. Vos,et al.  Cost-Effectiveness of Interventions to Promote Physical Activity: A Modelling Study , 2009, PLoS medicine.

[19]  A Gafni,et al.  Cost effectiveness/utility analyses. Do current decision rules lead us to where we want to be? , 1992, Journal of health economics.

[20]  A Gafni,et al.  Systematic validation of disease models for pharmacoeconomic evaluations. Swiss HIV Cohort Study. , 1999, Journal of evaluation in clinical practice.

[21]  J. Eisenberg,et al.  Views from funding agencies. Agency for Health Care Policy and Research. , 1998, Medical care.

[22]  A. Garber,et al.  Cost-Effectiveness of Alternative Test Strategies for the Diagnosis of Coronary Artery Disease , 1999, Annals of Internal Medicine.

[23]  David R. Holtgrave,et al.  Cost–threshold analyses of the National AIDS Demonstration Research HIV Prevention Interventions , 2000, AIDS.