A framework to establish credibility of computational models in biology.

Computational models in biology and biomedical science are often constructed to aid people's understanding of phenomena or to inform decisions with socioeconomic consequences. Model credibility is the willingness of people to trust a model's predictions and is often difficult to establish for computational biology models. A 3 × 3 matrix has been proposed to allow such models to be categorised with respect to their testability and epistemic foundation in order to guide the selection of an appropriate process of validation to supply evidence to establish credibility. Three approaches to validation are identified that can be deployed depending on whether a model is deemed untestable, testable or lies somewhere in between. In the latter two cases, the validation process involves the quantification of uncertainty which is a key output. The issues arising due to the complexity and inherent variability of biological systems are discussed and the creation of 'digital twins' proposed as a means to alleviate the issues and provide a more robust, transparent and traceable route to model credibility and acceptance.

[1]  Marco Viceconti,et al.  A tentative taxonomy for predictive models in relation to their falsifiability , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[2]  William L. Oberkampf,et al.  Scientific computer simulation review , 2015, Reliab. Eng. Syst. Saf..

[3]  Eve Marder,et al.  Computational models in the age of large datasets , 2015, Current Opinion in Neurobiology.

[4]  R. Hughes Models as Mediators: The Ising model, computer simulation, and universal physics , 1999 .

[5]  Charlotte Werndl,et al.  Climate models, confirmation and calibration , 2013 .

[6]  R. Jeffrey Valuation and Acceptance of Scientific Hypotheses , 1956, Philosophy of Science.

[7]  Melanie Mitchell,et al.  Complexity - A Guided Tour , 2009 .

[8]  Thomas H. Naylor,et al.  Verification of Computer Simulation Models , 1967 .

[9]  P. Luisi,et al.  The Systems View of Life: A Unifying Vision , 2014 .

[10]  Richard S. Rudner The Scientist Qua Scientist Makes Value Judgments , 1953, Philosophy of Science.

[11]  Marco Viceconti,et al.  Biomechanics-based in silico medicine: the manifesto of a new science. , 2015, Journal of biomechanics.

[12]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[13]  Charlotte Werndl,et al.  Climate Models, Calibration, and Confirmation , 2013, The British Journal for the Philosophy of Science.

[14]  Vernon Pratt,et al.  Philosophy of Biology. , 1995 .

[15]  Sarah Filippi,et al.  A framework for parameter estimation and model selection from experimental data in systems biology using approximate Bayesian computation , 2014, Nature Protocols.

[16]  Annamaria Carusi,et al.  Validation and variability: dual challenges on the path from systems biology to systems medicine. , 2014, Studies in history and philosophy of biological and biomedical sciences.

[17]  Stéphanie Mahévas,et al.  Supporting Fisheries Management by Means of Complex Models: Can We Point out Isles of Robustness in a Sea of Uncertainty? , 2013, PloS one.

[18]  Wolff-Michael Roth,et al.  Radical Uncertainty in Scientific Discovery Work , 2009 .

[19]  N Oreskes,et al.  Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences , 1994, Science.

[20]  Barbara Osimani,et al.  Causal Assessment of Pharmaceutical Treatments: Why Standards of Evidence Should not be the Same for Benefits and Harms? , 2014, Drug Safety.

[21]  Christopher J. Roy,et al.  A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing , 2011 .

[22]  Manuel DeLanda Philosophy and Simulation: The Emergence of Synthetic Reason , 2016 .

[23]  Eric Winsberg,et al.  Value judgements and the estimation of uncertainty in climate modeling , 2010 .

[24]  Ruth Koski Harris,et al.  Adrenal Cortex. Elaine P. Ralli , 1955 .

[25]  Sharon Munn,et al.  Adverse outcome pathway development II: best practices. , 2014, Toxicological sciences : an official journal of the Society of Toxicology.

[26]  Hiroaki Kitano,et al.  Lessons from Toxicology: Developing a 21st-Century Paradigm for Medical Research , 2015, Environmental health perspectives.

[27]  Andrew J. Bulpitt,et al.  A Primer on Learning in Bayesian Networks for Computational Biology , 2007, PLoS Comput. Biol..

[28]  David Madigan,et al.  Bayesian methods for design and analysis of safety trials , 2014, Pharmaceutical statistics.

[29]  Eric Winsberg,et al.  Science in the Age of Computer Simulation , 2010 .

[30]  Durant Drake Mind and its place in nature , 1927 .

[31]  L. Taylor,et al.  The Neglect of Experiment , 1986 .

[32]  M. Viceconti,et al.  Extracting clinically relevant data from finite element simulations. , 2005, Clinical biomechanics.

[33]  Eann A. Patterson,et al.  On the credibility of engineering models and meta-models , 2015 .

[34]  Mirosław Lachowicz,et al.  Individually-based Markov processes modeling nonlinear systems in mathematical biology , 2011 .

[35]  Eric Winsberg,et al.  Simulated Experiments: Methodology for a Virtual World , 2003, Philosophy of Science.

[36]  D. McShea,et al.  Biology's First Law: The Tendency for Diversity and Complexity to Increase in Evolutionary Systems , 2010 .

[37]  Kevin Burrage,et al.  Bridging experiments, models and simulations: an integrative approach to validation in computational cardiac electrophysiology. , 2012, American journal of physiology. Heart and circulatory physiology.

[38]  Marius Ghergu,et al.  Pattern Formation and the Gierer–Meinhardt Model in Molecular Biology , 2012 .

[39]  Gerhard Metzner,et al.  Mathematical modeling of allergy and specific immunotherapy: Th1-Th2-Treg interactions. , 2010, Journal of theoretical biology.

[40]  Charlotte Werndl,et al.  Model tuning in engineering: Uncovering the logic , 2016 .

[41]  Uskali Mäki The Methodology of Positive Economics , 2009 .

[42]  Erwin Hack,et al.  An approach to the validation of computational solid mechanics models for strain analysis , 2013 .

[43]  R. Audi Epistemology: A Contemporary Introduction to the Theory of Knowledge , 1997 .

[44]  Eann A. Patterson,et al.  A framework for an integrated nuclear digital environment , 2016 .