Credibility of In Silico Trial Technologies—A Theoretical Framing

Different research communities have developed various approaches to assess the credibility of predictive models. Each approach usually works well for a specific type of model, and under some epistemic conditions that are normally satisfied within that specific research domain. Some regulatory agencies recently started to consider evidences of safety and efficacy on new medical products obtained using computer modelling and simulation (which is referred to as In Silico Trials); this has raised the attention in the computational medicine research community on the regulatory science aspects of this emerging discipline. But this poses a foundational problem: in the domain of biomedical research the use of computer modelling is relatively recent, without a widely accepted epistemic framing for model credibility. Also, because of the inherent complexity of living organisms, biomedical modellers tend to use a variety of modelling methods, sometimes mixing them in the solution of a single problem. In such context merely adopting credibility approaches developed within other research communities might not be appropriate. In this paper we propose a theoretical framing for assessing the credibility of a predictive models for In Silico Trials, which accounts for the epistemic specificity of this research field and is general enough to be used for different type of models.

[1]  Marco Viceconti,et al.  In silico assessment of biomedical products: The conundrum of rare but not so rare events in two case studies , 2017, Proceedings of the Institution of Mechanical Engineers. Part H, Journal of engineering in medicine.

[2]  Patrick J. Roache,et al.  Verification and Validation in Computational Science and Engineering , 1998 .

[3]  A. Quaglino,et al.  Fast uncertainty quantification of activation sequences in patient‐specific cardiac electrophysiology meeting clinical time constraints , 2018, International journal for numerical methods in biomedical engineering.

[4]  Sebastian Schneckener,et al.  Development and validation of a physiology-based model for the prediction of pharmacokinetics/toxicokinetics in rabbits , 2018, PloS one.

[5]  Timothy G. Trucano,et al.  Verification and validation. , 2005 .

[6]  W. Wall,et al.  Towards efficient uncertainty quantification in complex and large-scale biomechanical problems based on a Bayesian multi-fidelity scheme , 2014, Biomechanics and Modeling in Mechanobiology.

[7]  Nicholas A Cilfone,et al.  Strategies for Efficient Numerical Implementation of Hybrid Multi-scale Agent-Based Models to Describe Biological Systems , 2014, Cellular and Molecular Bioengineering.

[8]  Pras Pathmanathan,et al.  Validation and Trustworthiness of Multiscale Models of Cardiac Electrophysiology , 2018, Front. Physiol..

[9]  Marco Viceconti,et al.  A tentative taxonomy for predictive models in relation to their falsifiability , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[10]  Ramana V. Grandhi,et al.  Prediction assessment and validation of multiscale models for additively manufactured lattice structures under uncertainty , 2019, Journal of Mechanical Science and Technology.

[11]  Matthew N Davies,et al.  In Silico Adjuvant Design and Validation. , 2017, Methods in molecular biology.

[12]  Moshe Y. Vardi,et al.  Verification , 1917, Handbook of Automata Theory.

[13]  Gary R. Mirams,et al.  Uncertainty and variability in computational and mathematical models of cardiac physiology , 2016, The Journal of physiology.

[14]  Danilo Bzdok,et al.  Points of Significance: Statistics versus machine learning , 2018, Nature Methods.

[15]  D. Cacuci,et al.  A Comparative Review of Sensitivity and Uncertainty Analysis of Large-Scale Systems—II: Statistical Methods , 2004 .

[16]  Yuan Guo-xing,et al.  Verification and Validation in Scientific Computing Code , 2010 .

[17]  M. Viceconti,et al.  Multiscale modeling methods in biomechanics , 2017, Wiley interdisciplinary reviews. Systems biology and medicine.

[18]  Adam Himes,et al.  Incorporation of stochastic engineering models as prior information in Bayesian medical device trials , 2017, Journal of biopharmaceutical statistics.

[19]  Marco Viceconti,et al.  Primary stability of an anatomical cementless hip stem: a statistical analysis. , 2006, Journal of biomechanics.

[20]  James Bailey,et al.  The vulnerability of learning to adversarial perturbation increases with intrinsic dimensionality , 2017, 2017 IEEE Workshop on Information Forensics and Security (WIFS).

[21]  Michael Campbell,et al.  Fracture prediction of cardiac lead medical devices using Bayesian networks , 2013, Reliab. Eng. Syst. Saf..

[22]  Francesco Pappalardo,et al.  Universal immune system simulator framework (UISS) , 2010, BCB '10.

[23]  John-Michael Sauer,et al.  Promoting Adoption of the 3Rs through Regulatory Qualification. , 2016, ILAR journal.

[24]  Mohamad Ivan Fanany,et al.  Adaptive Online Sequential ELM for Concept Drift Tackling , 2016, Comput. Intell. Neurosci..

[25]  Joseph F Contrera,et al.  Validation of Toxtree and SciQSAR in silico predictive software using a publicly available benchmark mutagenicity database and their applicability for the qualification of impurities in pharmaceuticals. , 2013, Regulatory toxicology and pharmacology : RTP.

[26]  Richard A. Malinauskas,et al.  Use of the FDA nozzle model to illustrate validation techniques in computational fluid dynamics (CFD) simulations , 2017, PloS one.

[27]  Bastien Chopard,et al.  Multiscale modelling and simulation: a position paper , 2014, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[28]  Patrick Knupp,et al.  Code Verification by the Method of Manufactured Solutions , 2000 .

[29]  Shobha Vasudevan,et al.  Still a Fight to Get It Right: Verification in the Era of Machine Learning , 2017, 2017 IEEE International Conference on Rebooting Computing (ICRC).

[30]  Lee W. Schruben,et al.  Establishing the credibility of simulations , 1980 .

[31]  Eric A Hoffman,et al.  Computational models of structure–function relationships in the pulmonary circulation and their validation , 2006, Experimental physiology.

[32]  Eann A Patterson,et al.  A framework to establish credibility of computational models in biology. , 2017, Progress in biophysics and molecular biology.

[33]  Ying Li,et al.  Multiscale modeling and uncertainty quantification in nanoparticle-mediated drug/gene delivery , 2014 .

[34]  Marco Viceconti,et al.  In silico clinical trials: concepts and early adoptions , 2019, Briefings Bioinform..

[35]  Giovanni Biglino,et al.  In Vitro Validation of a Multiscale Patient-Specific Norwood Palliation Model , 2016, ASAIO journal.