Using Metamodeling to Identify the Optimal Strategy for Colorectal Cancer Screening.

Abstract Objectives Metamodeling can address computational challenges within decision-analytic modeling studies evaluating many strategies. This article illustrates the value of metamodeling for evaluating colorectal cancer screening strategies while accounting for colonoscopy capacity constraints. Methods In a traditional approach, the best screening strategy was identified from a limited subset of strategies evaluated with the validated Adenoma and Serrated pathway to Colorectal CAncer model. In a metamodeling approach, metamodels were fitted to this limited subset to evaluate all potentially plausible strategies and determine the best overall screening strategy. Approaches were compared based on the best screening strategy in life-years gained compared with no screening. Metamodel runtime and accuracy was assessed. Results The metamodeling approach evaluated >40 000 strategies in Conclusions Metamodeling allows rapid assessment of a vast set of strategies, which may lead to identification of more favorable strategies compared to a traditional approach. Nevertheless, metamodel validation and identifying extrapolation beyond the support of the original decision-analytic model are critical to the interpretation of results. The screening strategies identified with metamodeling support ongoing discussions on decreasing the starting age of colorectal cancer screening.

[1]  Karl Claxton,et al.  Addressing Adoption and Research Design Decisions Simultaneously , 2011, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[3]  G. Meijer,et al.  Screening for Colorectal Cancer With Fecal Immunochemical Testing With and Without Postpolypectomy Surveillance Colonoscopy , 2017, Annals of Internal Medicine.

[4]  Anne Eisinga,et al.  A capture-recapture analysis demonstrated that randomized controlled trials evaluating the impact of diagnostic tests on patient outcomes are rare. , 2012, Journal of clinical epidemiology.

[5]  Jeremy E. Oakley,et al.  Bayesian History Matching of Complex Infectious Disease Models Using Emulation: A Tutorial and a Case Study on HIV in Uganda , 2015, PLoS Comput. Biol..

[6]  J. Emery,et al.  Benefits, Harms, and Cost-Effectiveness of Potential Age Extensions to the National Bowel Cancer Screening Program in Australia , 2018, Cancer Epidemiology, Biomarkers & Prevention.

[7]  K Degeling,et al.  A scoping review of metamodeling applications and opportunities for advanced health economic analyses , 2018, Expert review of pharmacoeconomics & outcomes research.

[8]  Fernando Alarid-Escudero,et al.  A Gaussian Approximation Approach for Value of Information Analysis , 2017, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  Bernd Bischl,et al.  Resampling Methods for Meta-Model Validation with Recommendations for Evolutionary Computation , 2012, Evolutionary Computation.

[10]  Jonathan Karnon,et al.  Model Parameter Estimation and Uncertainty: a Report of the Ispor-smdm Modeling Good Research Practices Task Force-6 Background to the Task Forcemodel-parameter-estimation-and- Uncertainty-analysis.asp). a Summary of These Articles Was Pre- Sented at a Plenary Session at the Ispor 16th Annual Intern , 2022 .

[11]  A. O'Hagan,et al.  Curve Fitting and Optimal Design for Prediction , 1978 .

[12]  Tiago M de Carvalho,et al.  Evaluating Parameter Uncertainty in a Simulation Model of Cancer Using Emulators , 2019, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  E. Kuipers,et al.  Modeling the Adenoma and Serrated Pathway to Colorectal CAncer (ASCCA) , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[14]  Paul Fockens,et al.  Participation and yield of colonoscopy versus non-cathartic CT colonography in population-based screening for colorectal cancer: a randomised controlled trial. , 2012, The Lancet. Oncology.

[15]  Dick den Hertog,et al.  Space-filling Latin hypercube designs for computer experiments , 2008 .

[16]  Jeremy E. Oakley,et al.  Estimating Multiparameter Partial Expected Value of Perfect Information from a Probabilistic Sensitivity Analysis Sample , 2013, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  Jesús Fernández-Villaverde,et al.  A Comparison of Programming Languages in Economics , 2015 .

[18]  E. Livingston,et al.  Rates of Colon and Rectal Cancers are Increasing in Young Adults , 2003, The American surgeon.

[19]  Mark Strong,et al.  Introduction to Metamodeling for Reducing Computational Burden of Advanced Analyses with Health Economic Models: A Structured Overview of Metamodeling Methods in a 6-Step Application Process , 2020, Medical decision making : an international journal of the Society for Medical Decision Making.

[20]  Maarten J. IJzerman,et al.  Application of Constrained Optimization Methods in Health Services Research: Report 2 of the ISPOR Optimization Methods Emerging Good Practices Task Force. , 2018, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[21]  J. Berkhof,et al.  The potential of imaging techniques as a screening tool for colorectal cancer: a cost-effectiveness analysis. , 2016, The British journal of radiology.

[22]  Onchee Yu,et al.  A hierarchical non‐homogenous Poisson model for meta‐analysis of adenoma counts , 2007, Statistics in medicine.

[23]  Fernando Alarid-Escudero,et al.  The Curve of Optimal Sample Size (COSS): A Graphical Representation of the Optimal Sample Size from a Value of Information Analysis , 2019, PharmacoEconomics.

[24]  Iftekhar A. Karimi,et al.  Design of computer experiments: A review , 2017, Comput. Chem. Eng..

[25]  G. Rinkel,et al.  Optimal screening strategy for familial intracranial aneurysms , 2010, Neurology.

[26]  G Baio,et al.  BCEA: A R Package to Perform Bayesian Cost-Effectiveness Analysis. , 2014, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[27]  P Tappenden,et al.  Methods for expected value of information analysis in complex health economic models: developments on the health economics of interferon-beta and glatiramer acetate for multiple sclerosis. , 2004, Health technology assessment.

[28]  Hendrik Koffijberg,et al.  A systematic review and checklist presenting the main challenges for health economic modeling in personalized medicine: towards implementing patient-level models , 2017, Expert review of pharmacoeconomics & outcomes research.

[29]  Nicolas Silva-Illanes,et al.  Critical Analysis of Markov Models Used for the Economic Evaluation of Colorectal Cancer Screening: A Systematic Review. , 2018, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[30]  Maarten J. IJzerman,et al.  Constrained Optimization Methods in Health Services Research-An Introduction: Report 1 of the ISPOR Optimization Methods Emerging Good Practices Task Force. , 2017, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[31]  C M Mangham,et al.  Nottingham trial of faecal occult blood testing for colorectal cancer: a 20-year follow-up , 2011, Gut.

[32]  Maarten J. IJzerman,et al.  Toward Alignment in the Reporting of Economic Evaluations of Diagnostic Tests and Biomarkers: The AGREEDT Checklist , 2018, Medical decision making : an international journal of the Society for Medical Decision Making.

[33]  M J Buxton,et al.  Modelling in economic evaluation: an unavoidable fact of life. , 1997, Health economics.

[34]  A. Zauber,et al.  The impact of the rising colorectal cancer incidence in young adults on the optimal age to start screening: Microsimulation analysis I to inform the American Cancer Society colorectal cancer screening guideline , 2018, Cancer.

[35]  Min Xie,et al.  A systematic comparison of metamodeling techniques for simulation optimization in Decision Support Systems , 2010, Appl. Soft Comput..

[36]  L. Rabeneck,et al.  The Global Paradigm Shift in Screening for Colorectal Cancer. , 2019, Gastroenterology.

[37]  Aasma Shaukat,et al.  Long-term mortality after screening for colorectal cancer. , 2013, The New England journal of medicine.