Spartan: A Comprehensive Tool for Understanding Uncertainty in Simulations of Biological Systems

Integrating computer simulation with conventional wet-lab research has proven to have much potential in furthering the understanding of biological systems. Success requires the relationship between simulation and the real-world system to be established: substantial aspects of the biological system are typically unknown, and the abstract nature of simulation can complicate interpretation of in silico results in terms of the biology. Here we present spartan (Simulation Parameter Analysis R Toolkit ApplicatioN), a package of statistical techniques specifically designed to help researchers understand this relationship and provide novel biological insight. The tools comprising spartan help identify which simulation results can be attributed to the dynamics of the modelled biological system, rather than artefacts of biological uncertainty or parametrisation, or simulation stochasticity. Statistical analyses reveal the influence that pathways and components have on simulation behaviour, offering valuable biological insight into aspects of the system under study. We demonstrate the power of spartan in providing critical insight into aspects of lymphoid tissue development in the small intestine through simulation. Spartan is released under a GPLv2 license, implemented within the open source R statistical environment, and freely available from both the Comprehensive R Archive Network (CRAN) and http://www.cs.york.ac.uk/spartan. The techniques within the package can be applied to traditional ordinary or partial differential equation simulations as well as agent-based implementations. Manuals, comprehensive tutorials, and example simulation data upon which spartan can be applied are available from the website.

[1]  Stefano Tarantola,et al.  Random balance designs for the estimation of first order global sensitivity indices , 2006, Reliab. Eng. Syst. Saf..

[2]  Jason G. Cyster,et al.  Overlapping Roles of CXCL13, Interleukin 7 Receptor α, and CCR7 Ligands in Lymph Node Development , 2003, The Journal of experimental medicine.

[3]  A. Vargha,et al.  A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and Wong , 2000 .

[4]  D. Harel,et al.  Toward rigorous comprehension of biological complexity: modeling, execution, and visualization of thymic T-cell maturation. , 2003, Genome research.

[5]  Frank Graziani Computational methods in transport : verification and validation , 2008 .

[6]  Peter C. Young,et al.  State Dependent Parameter metamodelling and sensitivity analysis , 2007, Comput. Phys. Commun..

[7]  A. Saltelli,et al.  An alternative way to compute Fourier amplitude sensitivity test (FAST) , 1998 .

[8]  Susan Stepney,et al.  The CoSMoS Process, Version 0.1: A Process for the Modelling and Simulation of Complex Systems , 2010 .

[9]  Paul S. Andrews,et al.  Pairing experimentation and computational modeling to understand the role of tissue inducer cells in the development of lymphoid organs , 2012, Front. Immun..

[10]  Tian Jin,et al.  Key Role of Local Regulation in Chemosensing Revealed by a New Molecular Interaction-Based Modeling Method , 2006, PLoS Comput. Biol..

[11]  J. C. Helton,et al.  Uncertainty and Sensitivity Analysis for Models of Complex Systems , 2008 .

[12]  J. Christian J. Ray,et al.  Synergy between Individual TNF-Dependent Functions Determines Granuloma Performance for Controlling Mycobacterium tuberculosis Infection1 , 2009, The Journal of Immunology.

[13]  Franco Celada,et al.  IMMSIM, a flexible model for in machina experiments on immune system responses , 2002, Future Gener. Comput. Syst..

[14]  Martin Meier-Schellersheim,et al.  Systems biology in immunology: a computational modeling perspective. , 2011, Annual review of immunology.

[15]  Jean-Paul Chilès,et al.  Wiley Series in Probability and Statistics , 2012 .

[16]  Ali S. Hadi,et al.  Wiley Series in Probability and Mathematical Statistics , 2008 .

[17]  Jon Timmis,et al.  Differential RET Signaling Pathways Drive Development of the Enteric Lymphoid and Nervous Systems , 2012, Science Signaling.

[18]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[19]  Vipin Kumar,et al.  Techniques for grounding agent-based simulations in the real domain: a case study in experimental autoimmune encephalomyelitis , 2012 .

[20]  D. Kirschner,et al.  A methodology for performing global uncertainty and sensitivity analysis in systems biology. , 2008, Journal of theoretical biology.

[21]  Denise E Kirschner,et al.  Mathematical and computational approaches can complement experimental studies of host-pathogen interactions. , 2009, Cellular microbiology.

[22]  T. Randall,et al.  Development of secondary lymphoid organs. , 2008, Annual review of immunology.