A call for virtual experiments: accelerating the scientific process.

Experimentation is fundamental to the scientific method, whether for exploration, description or explanation. We argue that promoting the reuse of virtual experiments (the in silico analogues of wet-lab or field experiments) would vastly improve the usefulness and relevance of computational models, encouraging critical scrutiny of models and serving as a common language between modellers and experimentalists. We review the benefits of reusable virtual experiments: in specifying, assaying, and comparing the behavioural repertoires of models; as prerequisites for reproducible research; to guide model reuse and composition; and for quality assurance in the translational application of models. A key step towards achieving this is that models and experimental protocols should be represented separately, but annotated so as to facilitate the linking of models to experiments and data. Lastly, we outline how the rigorous, streamlined confrontation between experimental datasets and candidate models would enable a "continuous integration" of biological knowledge, transforming our approach to systems biology.

[1]  Peter J. Hunter,et al.  Bioinformatics Applications Note Databases and Ontologies the Physiome Model Repository 2 , 2022 .

[2]  Christine Williams,et al.  Patch clamping by numbers. , 2004, Drug discovery today.

[3]  K H W J Ten Tusscher,et al.  Cell model for efficient simulation of wave propagation in human ventricular tissue under normal and pathological conditions , 2006, Physics in medicine and biology.

[4]  E. Sobie Parameter sensitivity analysis in electrophysiological models using multivariable regression. , 2009, Biophysical journal.

[5]  D. Foley,et al.  The economy needs agent-based modelling , 2009, Nature.

[6]  R. Peng Reproducible Research in Computational Science , 2011, Science.

[7]  Olaf Wolkenhauer,et al.  Considerations of graph-based concepts to manage of computational biology models and associated simulations , 2012, GI-Jahrestagung.

[8]  Nicolas Le Novère,et al.  Identifiers.org and MIRIAM Registry: community resources to provide persistent identification , 2011, Nucleic Acids Res..

[9]  Olaf Wolkenhauer,et al.  Improving the reuse of computational models through version control , 2013, Bioinform..

[10]  P Kohl,et al.  Model interactions: 'It is the simple, which is so difficult'. , 2011, Progress in biophysics and molecular biology.

[11]  Areles Molleman,et al.  Patch Clamping: An Introductory Guide To Patch Clamp Electrophysiology , 2002 .

[12]  C. Drummond Replicability is not Reproducibility:Nor is it Good Science , 2009 .

[13]  R Wilders,et al.  A computationally efficient electrophysiological model of human ventricular cells. , 2002, American journal of physiology. Heart and circulatory physiology.

[14]  Alfio Quarteroni,et al.  A vision and strategy for the virtual physiological human: 2012 update , 2013, Interface Focus.

[15]  Jonathan Cooper,et al.  Connecting Models to Data in Multiscale Multicellular Tissue Simulations , 2013, ICCS.

[16]  David L. Donoho,et al.  Three Dream Applications of Verifiable Computational Results , 2012, Computing in Science & Engineering.

[17]  Alexander V Panfilov,et al.  Comparison of electrophysiological models for human ventricular cells and tissues. , 2006, Progress in biophysics and molecular biology.

[18]  G. An,et al.  Agent‐based models in translational systems biology , 2009, Wiley interdisciplinary reviews. Systems biology and medicine.

[19]  David Gavaghan,et al.  Considerations for the use of cellular electrophysiology models within cardiac tissue simulations. , 2011, Progress in biophysics and molecular biology.

[20]  Henry Markram,et al.  The human brain project. , 2012, Scientific American.

[21]  Alfio Quarteroni,et al.  A vision and strategy for the virtual physiological human in 2010 and beyond , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[22]  Pras Pathmanathan,et al.  Ensuring reliability of safety-critical clinical applications of computational cardiac models , 2013, Front. Physiol..

[23]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[24]  J. Vik,et al.  Bridging the genotype–phenotype gap: what does it take? , 2013, The Journal of physiology.

[25]  Henggui Zhang,et al.  Cardiac cell modelling: observations from the heart of the cardiac physiome project. , 2011, Progress in biophysics and molecular biology.

[26]  David Kay,et al.  Stimulus Protocol Determines the Most Computationally Efficient Preconditioner for the Bidomain Equations , 2010, IEEE Transactions on Biomedical Engineering.

[27]  Christopher Winship,et al.  Counterfactuals and Causal Inference: Methods and Principles for Social Research , 2007 .

[28]  D. Lykken Statistical significance in psychological research. , 1968, Psychological bulletin.

[29]  Ian M. Mitchell,et al.  Reproducible research for scientific computing: Tools and strategies for changing the culture , 2012, Computing in Science & Engineering.

[30]  David Nickerson,et al.  Practical application of CellML 1.1: The integration of new mechanisms into a human ventricular myocyte model. , 2008, Progress in biophysics and molecular biology.

[31]  Suhasa B. Kodandaramaiah,et al.  Automated whole-cell patch clamp electrophysiology of neurons in vivo , 2012, Nature Methods.

[32]  Andrew Glover,et al.  Continuous Integration: Improving Software Quality and Reducing Risk (The Addison-Wesley Signature Series) , 2007 .

[33]  L. Parreira [From the genotype to the phenotype]. , 1999, Revista portuguesa de cardiologia : orgao oficial da Sociedade Portuguesa de Cardiologia = Portuguese journal of cardiology : an official journal of the Portuguese Society of Cardiology.

[34]  Bill Howe,et al.  Virtual Appliances, Cloud Computing, and Reproducible Research , 2012, Computing in Science & Engineering.

[35]  D. Noble A modification of the Hodgkin—Huxley equations applicable to Purkinje fibre action and pacemaker potentials , 1962, The Journal of physiology.

[36]  Gary R. Mirams,et al.  High-throughput functional curation of cellular electrophysiology models. , 2011, Progress in biophysics and molecular biology.

[37]  L. Duysens Preprints , 1966, Nature.

[38]  D. Noble Cardiac Action and Pacemaker Potentials based on the Hodgkin-Huxley Equations , 1960, Nature.

[39]  Steven F. Railsback,et al.  Individual-based modeling and ecology , 2005 .

[40]  Eugenio Culurciello,et al.  Automated, in-vivo, whole-cell electrophysiology using an integrated patch-clamp amplifier , 2013, BMC Neuroscience.

[41]  J. Gareth Polhill,et al.  The ODD protocol: A review and first update , 2010, Ecological Modelling.

[42]  Ian Hacking,et al.  Representing and Intervening: Introductory Topics in the Philosophy of Natural Science , 1983 .

[43]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[44]  Darrel C. Ince,et al.  The case for open computer programs , 2012, Nature.

[45]  Peter J. Hunter,et al.  The CellML Model Repository , 2008, Bioinform..

[46]  Birgit Müller,et al.  A standard protocol for describing individual-based and agent-based models , 2006 .

[47]  Thomas S. Kuhn,et al.  Mathematical vs. Experimental Traditions in the Development of Physical Science , 1976 .

[48]  Jacky L. Snoep,et al.  Reproducible computational biology experiments with SED-ML - The Simulation Experiment Description Markup Language , 2011, BMC Systems Biology.

[49]  Edmund J. Crampin,et al.  Computational biology of cardiac myocytes: proposed standards for the physiome , 2007, Journal of Experimental Biology.

[50]  Eric A. Sobie,et al.  Regression Analysis for Constraining Free Parameters in Electrophysiological Models of Cardiac Cells , 2009, PLoS Comput. Biol..

[51]  Hans Radder,et al.  The Philosophy Of Scientific Experimentation , 2003 .

[52]  Wei Chen,et al.  Assessing the Reliability of Complex Models: Mathematical and Statistical Foundations of Verification, Validation, and Uncertainty Quantification , 2012 .

[53]  Jacky L. Snoep,et al.  BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems , 2005, Nucleic Acids Res..

[54]  G. Bett,et al.  Computer model of action potential of mouse ventricular myocytes. , 2004, American journal of physiology. Heart and circulatory physiology.

[55]  Edmund J. Crampin,et al.  Minimum Information About a Simulation Experiment (MIASE) , 2011, PLoS Comput. Biol..

[56]  B. Palsson,et al.  The model organism as a system: integrating 'omics' data sets , 2006, Nature Reviews Molecular Cell Biology.

[57]  Eric Kerfoot,et al.  Verification of cardiac tissue electrophysiology simulators using an N-version benchmark , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[58]  Jennifer M. Urban,et al.  Shining Light into Black Boxes , 2012, Science.

[59]  Alexander G. Fletcher,et al.  Chaste: An Open Source C++ Library for Computational Physiology and Biology , 2013, PLoS Comput. Biol..

[60]  Bernard de Bono,et al.  The RICORDO approach to semantic interoperability for biomedical data and models: strategy, standards and solutions , 2011, BMC Research Notes.

[61]  Melanie I. Stefan,et al.  BioModels Database: An enhanced, curated and annotated resource for published quantitative kinetic models , 2010, BMC Systems Biology.

[62]  R. Hilborn,et al.  The Ecological Detective: Confronting Models with Data , 1997 .