Sensitivity Analysis of an ENteric Immunity SImulator (ENISI)-Based Model of Immune Responses to Helicobacter pylori Infection

Agent-based models (ABM) are widely used to study immune systems, providing a procedural and interactive view of the underlying system. The interaction of components and the behavior of individual objects is described procedurally as a function of the internal states and the local interactions, which are often stochastic in nature. Such models typically have complex structures and consist of a large number of modeling parameters. Determining the key modeling parameters which govern the outcomes of the system is very challenging. Sensitivity analysis plays a vital role in quantifying the impact of modeling parameters in massively interacting systems, including large complex ABM. The high computational cost of executing simulations impedes running experiments with exhaustive parameter settings. Existing techniques of analyzing such a complex system typically focus on local sensitivity analysis, i.e. one parameter at a time, or a close “neighborhood” of particular parameter settings. However, such methods are not adequate to measure the uncertainty and sensitivity of parameters accurately because they overlook the global impacts of parameters on the system. In this article, we develop novel experimental design and analysis techniques to perform both global and local sensitivity analysis of large-scale ABMs. The proposed method can efficiently identify the most significant parameters and quantify their contributions to outcomes of the system. We demonstrate the proposed methodology for ENteric Immune SImulator (ENISI), a large-scale ABM environment, using a computational model of immune responses to Helicobacter pylori colonization of the gastric mucosa.

[1]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[2]  H. Scheffé The Analysis of Variance , 1960 .

[3]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[4]  George A. F. Seber,et al.  Linear regression analysis , 1977 .

[5]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[6]  H. J. Gold,et al.  A Monte Carlo/response surface strategy for sensitivity analysis: application to a dynamic model of vegetative plant growth. , 1989, Applied mathematical modelling.

[7]  Henry P. Wynn,et al.  [Design and Analysis of Computer Experiments]: Rejoinder , 1989 .

[8]  Jack P. C. Kleijnen,et al.  Simulation: A Statistical Perspective , 1992 .

[9]  Stewart Robinson,et al.  Simulation: A Statistical Perspective , 1993 .

[10]  D. Hamby A comparison of sensitivity analysis techniques. , 1995, Health physics.

[11]  M. E. Williams,et al.  TRANSIMS: TRANSPORTATION ANALYSIS AND SIMULATION SYSTEM , 1995 .

[12]  Stephanie Forrest,et al.  Infect Recognize Destroy , 1996 .

[13]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[14]  Kenneth W. Bauer,et al.  Response surface methodology as a sensitivity analysis tool in decision analysis , 1999 .

[15]  Lih-Yuan Deng,et al.  Orthogonal Arrays: Theory and Applications , 1999, Technometrics.

[16]  A. Seely,et al.  Multiple organ dysfunction syndrome: Exploring the paradigm of complex nonlinear systems , 2000, Critical care medicine.

[17]  E A Neugebauer,et al.  Complexity and non-linearity in shock research: reductionism or synthesis? , 2001, Shock.

[18]  G An,et al.  Agent-based computer simulation and sirs: building a bridge between basic science and clinical trials. , 2001, Shock.

[19]  Antonio Lanzavecchia,et al.  Regulation of T Cell Immunity by Dendritic Cells , 2001, Cell.

[20]  T. Meyer,et al.  Helicobacter pylori Resists Phagocytosis by Macrophages: Quantitative Assessment by Confocal Microscopy and Fluorescence-Activated Cell Sorting , 2001, Infection and Immunity.

[21]  P. Jamieson,et al.  Simplifying Sirius: sensitivity analysis and development of a meta-model for wheat yield prediction , 2001 .

[22]  H Christopher Frey,et al.  OF SENSITIVITY ANALYSIS , 2001 .

[23]  Jack P. C. Kleijnen,et al.  Sensitivity analysis by experimental design and metamodelling: Case study on simulation in national animal disease control , 2003, Eur. J. Oper. Res..

[24]  R. Ahmed,et al.  CD8 T Cells Remember with a Little Help , 2003, Science.

[25]  Aravind Srinivasan,et al.  Modelling disease outbreaks in realistic urban social networks , 2004, Nature.

[26]  S. Pettersson,et al.  Commensal anaerobic gut bacteria attenuate inflammation by regulating nuclear-cytoplasmic shuttling of PPAR-γ and RelA , 2004, Nature Immunology.

[27]  Stefano Tarantola,et al.  Sensitivity Analysis in Practice: A Guide to Assessing Scientific Models , 2004 .

[28]  Antonio Lanzavecchia,et al.  Central memory and effector memory T cell subsets: function, generation, and maintenance. , 2004, Annual review of immunology.

[29]  S. Kasif,et al.  Whole-genome annotation by using evidence integration in functional-linkage networks. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[30]  Leo Lefrançois,et al.  Initial T cell frequency dictates memory CD8+ T cell lineage commitment , 2005, Nature Immunology.

[31]  Jack P. C. Kleijnen,et al.  State-of-the-Art Review: A User's Guide to the Brave New World of Designing Simulation Experiments , 2005, INFORMS J. Comput..

[32]  Ionel Michael Navon,et al.  Sensitivity and Uncertainty Analysis, Volume II: Applications to Large-Scale Systems , 2005 .

[33]  J. S. Hunter,et al.  Statistics for Experimenters: Design, Innovation, and Discovery , 2006 .

[34]  Kathrin Happe,et al.  Agent-Based Modelling and Sensitivity Analysis by Experimental Design and Metamodelling: An Application to Modelling Regional Structural Change , 2005 .

[35]  D. Cacuci,et al.  Applications to large-scale systems , 2005 .

[36]  Gary An,et al.  Concepts for developing a collaborative in silico model of the acute inflammatory response using agent-based modeling. , 2006, Journal of critical care.

[37]  Gilles Clermont,et al.  IN SILICO MODELS OF ACUTE INFLAMMATION IN ANIMALS , 2006, Shock.

[38]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[39]  F Castiglione,et al.  An enhanced agent based model of the immune system response. , 2006, Cellular immunology.

[40]  Reinhard Laubenbacher,et al.  A Virtual Look at Epstein–Barr Virus Infection: Biological Interpretations , 2007, PLoS pathogens.

[41]  G. Clermont,et al.  Agent‐based model of inflammation and wound healing: insights into diabetic foot ulcer pathology and the role of transforming growth factor‐β1 , 2007 .

[42]  G. Fitzgerald,et al.  Rapid Screening Method for Analyzing the Conjugated Linoleic Acid Production Capabilities of Bacterial Cultures , 2007, Applied and Environmental Microbiology.

[43]  Gary An,et al.  Theoretical Biology and Medical Modelling , 2022 .

[44]  Gregg Rothermel,et al.  Using sensitivity analysis to create simplified economic models for regression testing , 2008, ISSTA '08.

[45]  S. Calvano,et al.  Challenges for modeling and interpreting the complex biology of severe injury and inflammation , 2008, Journal of leukocyte biology.

[46]  Gary An,et al.  Translational Systems Biology: Introduction of an Engineering Approach to the Pathophysiology of the Burn Patient , 2008, Journal of burn care & research : official publication of the American Burn Association.

[47]  Madhav V. Marathe,et al.  EpiSimdemics: an efficient algorithm for simulating the spread of infectious disease over large realistic social networks , 2008, HiPC 2008.

[48]  Nicholas F. Polys,et al.  A virtual look at Epstein-Barr virus infection: simulation mechanism. , 2008, Journal of theoretical biology.

[49]  J. C. Helton,et al.  Uncertainty and Sensitivity Analysis for Models of Complex Systems , 2008 .

[50]  Madhav V. Marathe,et al.  EpiSimdemics: An efficient algorithm for simulating the spread of infectious disease over large realistic social networks , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[51]  Frank Graziani Computational methods in transport : verification and validation , 2008 .

[52]  Max D. Morris,et al.  Using Orthogonal Arrays in the Sensitivity Analysis of Computer Models , 2008, Technometrics.

[53]  C. F. Jeff Wu,et al.  Experiments , 2021, Wiley Series in Probability and Statistics.

[54]  Alan S. Perelson,et al.  Agent-based modeling of host–pathogen systems: The successes and challenges , 2008, Information Sciences.

[55]  Sandeep K. Shukla,et al.  Fundamental Problems in Computing, Essays in Honor of Professor Daniel J. Rosenkrantz , 2009, Fundamental Problems in Computing.

[56]  Ram Naresh,et al.  The Intestinal Spirochete Brachyspira pilosicoli Attaches to Cultured Caco-2 Cells and Induces Pathological Changes , 2009, PloS one.

[57]  I. Androulakis,et al.  Agent-Based Modeling of Endotoxin-Induced Acute Inflammatory Response in Human Blood Leukocytes , 2010, PloS one.

[58]  Arghavan Louhghalam,et al.  Variance decomposition and global sensitivity for structural systems , 2010 .

[59]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[60]  Raquel Hontecillas,et al.  Model of colonic inflammation: immune modulatory mechanisms in inflammatory bowel disease. , 2010, Journal of theoretical biology.

[61]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[62]  P. Malfertheiner,et al.  Role of regulatory T-cells in H. pylori-induced gastritis and gastric cancer. , 2010, Anticancer research.

[63]  T. Sumner Sensitivity analysis in systems biology modelling and its application to a multi-scale model of blood glucose homeostasis , 2010 .

[64]  Madhav V. Marathe,et al.  ENteric Immunity SImulator: A Tool for in silico Study of Gut Immunopathologies , 2011, 2011 IEEE International Conference on Bioinformatics and Biomedicine.

[65]  Frédéric Hollande,et al.  Gastric Sonic Hedgehog acts as a macrophage chemoattractant during the immune response to Helicobacter pylori. , 2012, Gastroenterology.

[66]  Julio R. Banga,et al.  Novel global sensitivity analysis methodology accounting for the crucial role of the distribution of input parameters: application to systems biology models , 2012 .

[67]  A. Finkelstein,et al.  A composite computational model of liver glucose homeostasis. II. Exploring system behaviour , 2012, Journal of The Royal Society Interface.

[68]  Madhav V. Marathe,et al.  High-Performance Interaction-Based Simulation of Gut Immunopathologies with ENteric Immunity Simulator (ENISI) , 2012, 2012 IEEE 26th International Parallel and Distributed Processing Symposium.

[69]  T Sumner,et al.  A methodology for global-sensitivity analysis of time-dependent outputs in systems biology modelling , 2012, Journal of The Royal Society Interface.

[70]  B. Sobral,et al.  Helicobacter pylori Colonization Ameliorates Glucose Homeostasis in Mice through a PPAR γ-Dependent Mechanism , 2012, PloS one.

[71]  Madhav V. Marathe,et al.  ENISI Visual, an agent-based simulator for modeling gut immunity , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[72]  M. Marathe,et al.  ENteric Immunity SImulator: A Tool for In Silico Study of Gastroenteric Infections , 2012, IEEE Transactions on NanoBioscience.

[73]  Marc C. Kennedy,et al.  A Bayesian sensitivity analysis applied to an Agent-based model of bird population response to landscape change , 2013, Environ. Model. Softw..

[74]  Maria Fonoberova,et al.  Global sensitivity/uncertainty analysis for agent-based models , 2013, Reliab. Eng. Syst. Saf..

[75]  M. Marathe,et al.  Predictive Computational Modeling of the Mucosal Immune Responses during Helicobacter pylori Infection , 2013, PloS one.

[76]  Madhav V. Marathe,et al.  Interactions among human behavior, social networks, and societal infrastructures: A Case Study in Computational Epidemiology , 2013, Fundamental Problems in Computing.

[77]  Michael B. Miller Linear Regression Analysis , 2013 .

[78]  Madhav V. Marathe,et al.  Systems Modeling of Molecular Mechanisms Controlling Cytokine-driven CD4+ T Cell Differentiation and Phenotype Plasticity , 2013, PLoS Comput. Biol..

[79]  David Abramson,et al.  A local sensitivity analysis method for developing biological models with identifiable parameters: Application to cardiac ionic channel modelling , 2013, Future Gener. Comput. Syst..

[80]  J. Bassaganya-Riera,et al.  Computational modeling of heterogeneity and function of CD4+ T cells , 2014, Front. Cell Dev. Biol..

[81]  Raquel Hontecillas,et al.  Systems Modeling of the Role of Interleukin-21 in the Maintenance of Effector CD4+ T Cell Responses during Chronic Helicobacter pylori Infection , 2014, mBio.

[82]  G.A.K. van Voorn,et al.  Sensitivity analysis for agent-based models: a low complexity test-case , 2014 .

[83]  Marleen Schouten,et al.  Comparing two sensitivity analysis approaches for two scenarios with a spatially explicit rural agent-based model , 2014, Environ. Model. Softw..

[84]  Yongguo Mei,et al.  ENISI MSM: A novel multi-scale modeling platform for computational immunology , 2014, 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[85]  J. Bassaganya-Riera,et al.  Novel insights on the role of CD8+ T cells and cytotoxic responses during Helicobacter pylori infection , 2014, Gut microbes.

[86]  P. Soranno,et al.  Using Uncertainty and Sensitivity Analyses in Socioecological Agent-Based Models to Improve Their Analytical Performance and Policy Relevance , 2014, PloS one.

[87]  J. Bassaganya-Riera,et al.  Multiscale modeling of mucosal immune responses , 2015, BMC Bioinformatics.

[88]  J. Bassaganya-Riera,et al.  Modeling the Dynamics of T Helper 17 Induction and Differentiation , 2015 .

[89]  R. Nusse,et al.  Helicobacter pylori Activates and Expands Lgr5(+) Stem Cells Through Direct Colonization of the Gastric Glands. , 2015, Gastroenterology.

[90]  J. Bassaganya-Riera,et al.  Systems Modeling of Interactions between Mucosal Immunity and the Gut Microbiome during Clostridium difficile Infection , 2015, PloS one.

[91]  Jennifer Werfel,et al.  Orthogonal Arrays Theory And Applications , 2016 .