Using CART to Identify Thresholds and Hierarchies in the Determinants of Funding Decisions

There is much interest in understanding decision-making processes that determine funding outcomes for health interventions. We use classification and regression trees (CART) to identify cost-effectiveness thresholds and hierarchies in the determinants of funding decisions. The hierarchical structure of CART is suited to analyzing complex conditional and nonlinear relationships. Our analysis uncovered hierarchies where interventions were grouped according to their type and objective. Cost-effectiveness thresholds varied markedly depending on which group the intervention belonged to: lifestyle-type interventions with a prevention objective had an incremental cost-effectiveness threshold of $2356, suggesting that such interventions need to be close to cost saving or dominant to be funded. For lifestyle-type interventions with a treatment objective, the threshold was much higher at $37,024. Lower down the tree, intervention attributes such as the level of patient contribution and the eligibility for government reimbursement influenced the likelihood of funding within groups of similar interventions. Comparison between our CART models and previously published results demonstrated concurrence with standard regression techniques while providing additional insights regarding the role of the funding environment and the structure of decision-maker preferences.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  Ping Zhang Model Selection Via Multifold Cross Validation , 1993 .

[3]  N. Devlin,et al.  The Influence of Cost-Effectiveness and Other Factors on NICE Decisions , 2010, Health economics.

[4]  Jing Jing Li,et al.  Using effectiveness and cost-effectiveness to make drug coverage decisions: a comparison of Britain, Australia, and Canada. , 2009, JAMA.

[5]  F Dannegger,et al.  Tree stability diagnostics and some remedies for instability. , 2000, Statistics in medicine.

[6]  M. Knapp,et al.  Public funding of pharmaceuticals in the Netherlands: investigating the effect of evidence, process and context on CVZ decision-making , 2014, The European Journal of Health Economics.

[7]  Hal R. Varian,et al.  Big Data: New Tricks for Econometrics , 2014 .

[8]  Stirling Bryan,et al.  Seeing the NICE side of cost-effectiveness analysis: a qualitative investigation of the use of CEA in NICE technology appraisals. , 2007, Health economics.

[9]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[10]  K. Baumstarck,et al.  Exploring the Response Shift Effect on the Quality of Life of Patients with Schizophrenia , 2015, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  James Raftery,et al.  NICE and the challenge of cancer drugs , 2009, BMJ : British Medical Journal.

[12]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[13]  K. Hornik,et al.  party : A Laboratory for Recursive Partytioning , 2009 .

[14]  W. Rogowski,et al.  Transparency vs. closed-door policy: do process characteristics have an impact on the outcomes of coverage decisions? A statistical analysis. , 2013, Health policy.

[15]  K. Fischer,et al.  A systematic review of coverage decision-making on health technologies-evidence from the real world. , 2012, Health policy.

[16]  Roman Timofeev,et al.  Classification and Regression Trees(CART)Theory and Applications , 2004 .

[17]  M. Drummond,et al.  Public funding of new cancer drugs: Is NICE getting nastier? , 2009, European journal of cancer.

[18]  Leonie Segal,et al.  Fixing the game: are between-silo differences in funding arrangements handicapping some interventions and giving others a head-start? , 2010, Health economics.

[19]  Philip S. Yu,et al.  Top 10 algorithms in data mining , 2007, Knowledge and Information Systems.

[20]  Martin Knapp,et al.  Decision making by NICE: examining the influences of evidence, process and context , 2013, Health Economics, Policy and Law.

[21]  Nancy J Devlin,et al.  "Yes", "No" or "Yes, but"? Multinomial modelling of NICE decision-making. , 2006, Health policy.

[22]  S. Hill,et al.  Cost-effectiveness and resource allocation - Reply , 2006 .

[23]  R. Foy,et al.  Perspectives of commissioners and cancer specialists in prioritising new cancer drugs: impact of the evidence threshold , 1999, BMJ.

[24]  David Parkin,et al.  Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. , 2004, Health economics.

[25]  D. Hughes,et al.  Drugs for exceptionally rare diseases: do they deserve special status for funding? , 2005, QJM : monthly journal of the Association of Physicians.

[26]  Jing Jing Li,et al.  The Role of Value for Money in Public Insurance Coverage Decisions for Drugs in Australia: A Retrospective Analysis 1994-2004 , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[27]  Kalipso Chalkidou,et al.  Evidence and values: paying for end-of-life drugs in the British NHS , 2012, Health Economics, Policy and Law.

[28]  Sue P O'Malley The Australian experiment: the use of evidence based medicine for the reimbursement of surgical and diagnostic procedures (1998–2004) , 2006, Australia and New Zealand health policy.

[29]  C. McCabe,et al.  Public healthcare resource allocation and the Rule of Rescue , 2008, Journal of Medical Ethics.

[30]  D. Menon,et al.  The role of economic evidence in Canadian oncology reimbursement decision-making: to lambda and beyond. , 2008, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[31]  M. Buxton,et al.  Searching for cost effectiveness thresholds in the NHS. , 2009, Health policy.

[32]  D. Mortimer,et al.  Review of Australian health economic evaluation – 245 interventions: what can we say about cost effectiveness? , 2008, Cost effectiveness and resource allocation : C/E.

[33]  A. Harris,et al.  Cost-Effectiveness Analysis and the Consistency of Decision Making , 2012, PharmacoEconomics.