Optimization and Control of Agent-Based Models in Biology: A Perspective

Agent-based models (ABMs) have become an increasingly important mode of inquiry for the life sciences. They are particularly valuable for systems that are not understood well enough to build an equation-based model. These advantages, however, are counterbalanced by the difficulty of analyzing and using ABMs, due to the lack of the type of mathematical tools available for more traditional models, which leaves simulation as the primary approach. As models become large, simulation becomes challenging. This paper proposes a novel approach to two mathematical aspects of ABMs, optimization and control, and it presents a few first steps outlining how one might carry out this approach. Rather than viewing the ABM as a model, it is to be viewed as a surrogate for the actual system. For a given optimization or control problem (which may change over time), the surrogate system is modeled instead, using data from the ABM and a modeling framework for which ready-made mathematical tools exist, such as differential equations, or for which control strategies can explored more easily. Once the optimization problem is solved for the model of the surrogate, it is then lifted to the surrogate and tested. The final step is to lift the optimization solution from the surrogate system to the actual system. This program is illustrated with published work, using two relatively simple ABMs as a demonstration, Sugarscape and a consumer-resource ABM. Specific techniques discussed include dimension reduction and approximation of an ABM by difference equations as well systems of PDEs, related to certain specific control objectives. This demonstration illustrates the very challenging mathematical problems that need to be solved before this approach can be realistically applied to complex and large ABMs, current and future. The paper outlines a research program to address them.

[1]  Ioannis G. Kevrekidis,et al.  Equation-free: The computer-aided analysis of complex multiscale systems , 2004 .

[2]  Denise Kirschner,et al.  A population model capturing dynamics of tuberculosis granulomas predicts host infection outcomes. , 2015, Mathematical biosciences and engineering : MBE.

[3]  Joshua M. Epstein,et al.  Growing artificial societies , 1996 .

[4]  P. H. Diananda,et al.  Contributions to the theory of statistical estimation , 1949 .

[5]  Jack Dongarra,et al.  Computational Science: Ensuring America's Competitiveness , 2005 .

[6]  John McCardell The drinking age. The status quo has bombed. , 2008, U.S. news & world report.

[7]  M. Kristi Henzel,et al.  A Computational, Tissue-Realistic Model of Pressure Ulcer Formation in Individuals with Spinal Cord Injury , 2013, PLoS Comput. Biol..

[8]  J. I The Design of Experiments , 1936, Nature.

[9]  Reinhard Laubenbacher,et al.  Optimal Harvesting for a Predator-Prey Agent-Based Model using Difference Equations , 2015, Bulletin of Mathematical Biology.

[10]  A. Wald Contributions to the Theory of Statistical Estimation and Testing Hypotheses , 1939 .

[11]  Takeru Igusa,et al.  Examining social norm impacts on obesity and eating behaviors among US school children based on agent-based model , 2014, BMC Public Health.

[12]  Bruce Edmonds,et al.  Measuring Simulation-Observation Fit: An Introduction to Ordinal Pattern Analysis , 2013, J. Artif. Soc. Soc. Simul..

[13]  Dan Ryan,et al.  Optimal Control in Individual-Based Models: Implications from Aggregated Methods , 2012, The American Naturalist.

[14]  Suzanne Lenhart,et al.  Optimal control of sugarscape agent‐based model via a PDE approximation model , 2017 .

[15]  Reinhard C. Laubenbacher,et al.  Optimization of Agent-Based Models: Scaling Methods and Heuristic Algorithms , 2014, J. Artif. Soc. Soc. Simul..

[16]  Wander Jager,et al.  Put Your Money Where Your Mouth Is: DIAL, A Dialogical Model for Opinion Dynamics , 2013, J. Artif. Soc. Soc. Simul..

[17]  Jiongmin Yong,et al.  Optimal Controls for Stochastic Partial Differential Equations with an Application in Population Modeling , 2016, SIAM J. Control. Optim..

[18]  Ingo Roeder,et al.  Dynamic modeling of imatinib-treated chronic myeloid leukemia: functional insights and clinical implications , 2006, Nature Medicine.

[19]  Elizabeth Polidan,et al.  On the Effectiveness of Social Norms Intervention in College Drinking: The Roles of Identity Verification and Peer Influence. , 2016, Alcoholism, clinical and experimental research.

[20]  Abdul Salam Jarrah,et al.  A Mathematical Framework for Agent Based Models of Complex Biological Networks , 2010, Bulletin of mathematical biology.

[21]  G. Nigel Gilbert,et al.  Agent-Based Models , 2007 .

[22]  Phillip D. Stroud,et al.  Spatial Dynamics of Pandemic Influenza in a Massive Artificial Society , 2007, J. Artif. Soc. Soc. Simul..

[23]  René A. Salinas,et al.  A METAPOPULATION MODEL FOR FERAL HOGS IN GREAT SMOKY MOUNTAINS NATIONAL PARK , 2016 .

[24]  Steven F. Railsback,et al.  Agent-Based and Individual-Based Modeling: A Practical Introduction , 2011 .

[25]  Steven F. Railsback,et al.  Individual-based modeling and ecology , 2005 .

[26]  Kurt C. VerCauteren,et al.  AN INDIVIDUAL‐BASED MODEL FOR FERAL HOGS IN GREAT SMOKY MOUNTAINS NATIONAL PARK , 2015 .

[27]  M. Nisio,et al.  Optimal controls for stochastic partial differential equations , 1990 .

[28]  John D. Peine,et al.  WILD HOG MANAGEMENT PROGRAM AT GREAT SMOKY MOUNTAINS NATIONAL PARK , 1990 .

[29]  A. Armaou,et al.  Continuous-time control of distributed processes via microscopic simulations , 2004, Proceedings of the 2004 American Control Conference.

[30]  Stephen Eubank,et al.  Network based models of infectious disease spread. , 2005, Japanese journal of infectious diseases.

[31]  Thomas C. Schelling,et al.  Dynamic models of segregation , 1971 .

[32]  Ben G Fitzpatrick,et al.  Forecasting the effect of the Amethyst initiative on college drinking. , 2012, Alcoholism, clinical and experimental research.

[33]  T. J. Mitchell,et al.  Bayesian design and analysis of computer experiments: Use of derivatives in surface prediction , 1993 .

[34]  Reinhard Laubenbacher,et al.  Using difference equations to find optimal tax structures on the SugarScape , 2014 .

[35]  U. Netlogo Wilensky,et al.  Center for Connected Learning and Computer-Based Modeling , 1999 .

[36]  Doron Levy,et al.  A PDE Model for Imatinib-Treated Chronic Myelogenous Leukemia , 2008, Bulletin of mathematical biology.

[37]  Uta Berger,et al.  Pattern-Oriented Modeling of Agent-Based Complex Systems: Lessons from Ecology , 2005, Science.

[38]  Doron Levy,et al.  Modeling Imatinib-Treated Chronic Myelogenous Leukemia: Reducing the Complexity of Agent-Based Models , 2008, Bulletin of mathematical biology.